-- Logs begin at Wed 2022-09-28 11:33:46 UTC, end at Wed 2022-09-28 13:03:50 UTC. -- Sep 28 12:06:06.217822 dv-cinder-859193-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 12:06:06.226437 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:06:06 2022] *** Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: nodename: dv-cinder-859193-2-iscsi Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: machine: x86_64 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: clock source: unix Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: pcre jit disabled Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: detected number of CPU cores: 4 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: current working directory: / Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: your processes number limit is 47680 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: your memory page size is 4096 bytes Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: detected max file descriptor number: 2048 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: lock engine: pthread robust mutexes Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: thunder lock: enabled Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 12:06:06.229274 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:06:06.267346 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: Python main interpreter initialized at 0x555eec0b99c0 Sep 28 12:06:06.267346 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: python threads support enabled Sep 28 12:06:06.267346 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: your server socket listen backlog is limited to 100 connections Sep 28 12:06:06.267346 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:06:06.267695 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:06:06.267775 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: *** Operational MODE: preforking *** Sep 28 12:06:06.267996 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:06:06.267996 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: spawned uWSGI master process (pid: 105578) Sep 28 12:06:06.268196 dv-cinder-859193-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 12:06:06.268730 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: spawned uWSGI worker 1 (pid: 105579, cores: 1) Sep 28 12:06:06.269061 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: spawned uWSGI worker 2 (pid: 105580, cores: 1) Sep 28 12:06:06.269235 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:06:06.923332 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:06:06.923937 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:06:08.002243 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:06:08.002243 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: from cryptography.utils import int_from_bytes Sep 28 12:06:08.002878 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:06:08.002878 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: from cryptography.utils import int_from_bytes Sep 28 12:06:08.003820 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:06:08.003820 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: from cryptography.utils import int_from_bytes Sep 28 12:06:08.004242 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:06:08.004242 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: from cryptography.utils import int_from_bytes Sep 28 12:06:10.486571 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:06:10.487219 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:06:10.487356 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:06:10.487720 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:06:10.487973 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:06:10.488293 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:06:10.488713 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.488817 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:06:10.488910 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.489002 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.491786 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:06:10.491786 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:06:10.491786 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:06:10.491786 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.491786 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492476 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492628 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492732 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492807 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492880 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.492951 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493022 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493099 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493166 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493236 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493307 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493373 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493443 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493521 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493521 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.493521 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494168 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494242 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-2-iscsi {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494321 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-2-iscsi {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494398 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494475 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494546 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494620 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494691 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.494950 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.495039 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.495176 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.495267 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.495487 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.495588 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.496052 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.496582 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.497029 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.497298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.497607 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.497952 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.498179 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.498335 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.498744 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.498911 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.499164 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.499386 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.499586 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.499776 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.499988 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.500194 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.500457 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.500656 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.500883 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.501099 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.501318 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-2-iscsi {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.501542 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.501766 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.501968 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502150 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502284 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502424 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502559 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502559 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502809 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502809 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.502809 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.503176 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.503428 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.503732 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.504055 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.504392 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.504711 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.504851 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-2-iscsi {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505043 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505225 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505360 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505524 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505660 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.505832 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506220 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506400 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506537 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506719 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.506855 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507018 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507156 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507283 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507407 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507538 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507677 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.507857 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508007 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508172 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508335 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508515 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508681 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.508934 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509057 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509203 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509339 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509501 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509646 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509815 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.509952 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510135 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510281 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510442 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510571 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510748 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.510884 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511021 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511160 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511286 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511417 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511607 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511744 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.511907 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512042 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512220 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512416 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512561 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512698 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512837 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.512973 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513108 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513242 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513375 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513516 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513698 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.513928 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514080 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514207 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514340 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514483 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514621 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514747 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.514883 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515015 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515143 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515284 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515418 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515586 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515727 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.515901 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516037 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516205 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516376 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516533 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516683 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516839 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.516975 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517153 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517285 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517485 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517616 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517787 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.517930 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518068 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518194 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518326 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518464 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518604 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518777 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.518906 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519086 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519222 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519404 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519533 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519726 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.519857 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520036 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520165 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520355 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520488 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520661 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520799 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.520985 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521123 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521256 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521394 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521546 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521675 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521831 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.521958 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522131 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522275 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522432 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522570 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522733 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.522862 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523033 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523179 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523337 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523471 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523644 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523773 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.523944 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524081 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524245 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524413 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524559 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524687 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524860 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.524999 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525163 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525291 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525461 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525597 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525762 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.525901 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526064 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526191 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526366 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526503 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526668 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526806 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.526969 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527108 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527267 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527402 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527568 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527709 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.527876 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528014 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528169 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528297 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528498 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528705 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528835 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.528959 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.529084 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.529197 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.529911 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530050 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530209 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530337 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530514 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530643 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530814 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.530946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531114 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531250 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531412 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531541 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531711 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.531841 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532004 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532132 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532331 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532483 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532639 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532775 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.532942 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533077 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533246 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533385 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533549 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533677 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533855 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.533991 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.534159 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.534300 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.534463 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.534591 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.534766 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.534896 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.535071 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.535214 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.535375 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.535512 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.535678 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.535816 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.535978 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.536109 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.536292 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.536481 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.536634 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.536784 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.536942 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.537065 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.537246 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.537380 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.537547 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.537674 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.538329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.538711 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:06:10.538831 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.538940 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539057 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539175 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539296 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539404 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539516 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539634 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539749 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539868 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.539985 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.540098 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.540205 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.540349 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.540491 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542259 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542259 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542546 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542693 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542823 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.542949 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543084 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543210 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543341 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543476 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543602 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543727 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543861 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.543988 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544112 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544233 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544416 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544556 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544697 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.544891 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.545096 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.545719 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.545852 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.545989 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546125 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546252 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546378 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546511 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546646 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546786 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.546914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547046 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547173 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547298 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547433 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547568 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547703 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547829 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.547963 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548097 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548231 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548399 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548527 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548654 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548779 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.548912 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549039 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549176 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549303 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549429 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549561 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549687 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549816 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.549952 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550079 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550205 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550330 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550463 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550599 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550723 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550831 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.550957 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551090 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551216 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551350 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551350 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551589 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551714 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551841 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.551965 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552150 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552278 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552419 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552547 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552692 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552821 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.552965 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553093 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553219 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553343 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553524 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553663 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553791 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.553925 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554058 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554184 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554321 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554456 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554583 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554708 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554839 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.554974 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555100 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555234 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555361 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555486 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555618 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555744 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.555870 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556005 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556139 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556265 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556416 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556609 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556754 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.556910 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557041 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557213 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557335 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557521 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557660 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557829 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.557970 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558135 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558265 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558445 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558584 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558752 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.558882 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559059 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559364 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559501 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559671 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559801 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.559977 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560113 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560284 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560465 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560672 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560801 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.560981 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561110 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561288 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561441 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561602 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561730 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.561884 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562014 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562190 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562323 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562494 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562624 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562779 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.562909 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563081 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563225 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563388 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563526 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563687 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563826 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.563989 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564150 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564277 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564461 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564590 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564724 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.564884 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565014 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565198 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565339 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565503 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565642 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565802 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.565941 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566100 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566231 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566401 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566541 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566731 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.566860 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567030 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567158 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567336 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567457 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567639 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567769 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.567945 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568076 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568251 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568400 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568594 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568726 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.568898 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569039 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569203 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569332 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569511 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569656 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569811 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.569939 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570132 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570273 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570399 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570523 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570726 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.570863 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571031 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571166 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571335 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571463 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571652 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571791 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.571959 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572089 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572274 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572477 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572606 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572753 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.572882 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573008 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573217 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573347 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573539 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573681 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573852 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.573981 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574164 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574294 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574473 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574594 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574785 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.574916 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575093 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575230 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575401 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575542 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575706 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.575834 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576014 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576168 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576391 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576521 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576701 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.576838 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577017 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577145 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577319 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577449 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577635 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577771 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.577942 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578073 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578255 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578386 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578556 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578686 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.578867 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579006 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579179 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579307 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579492 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579621 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579793 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.579997 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580128 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580252 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580431 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580562 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580734 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.580873 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581043 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581167 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581351 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581482 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581655 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581794 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.581958 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582095 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582267 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582397 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582568 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582706 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.582872 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583000 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583180 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583312 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583482 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583612 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583791 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.583921 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584095 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584224 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584421 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584553 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584723 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.584861 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585030 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585160 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585340 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585469 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585645 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585774 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.585947 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586084 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586257 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586388 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586554 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586682 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.586868 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587008 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587152 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587280 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587443 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587581 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587745 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.587886 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588044 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588173 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588364 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588509 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588671 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588816 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.588984 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589115 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589281 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589410 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589593 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589732 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.589909 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.590037 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.590215 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.590343 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.590521 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.590898 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.591074 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.591195 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.591376 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.591504 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.591692 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.592373 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.592536 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.592676 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.592842 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.592971 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593144 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593274 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593448 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593585 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593756 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.593887 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594064 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594195 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594375 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594504 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594677 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594807 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.594983 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595113 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595288 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595417 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595586 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595725 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.595891 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596019 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596200 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596351 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596546 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596791 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.596938 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597121 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597251 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597434 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597571 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597740 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.597875 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598048 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598178 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598368 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598512 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598676 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598815 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.598985 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599117 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599294 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599424 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599594 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599729 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.599897 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600025 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600196 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600386 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600528 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600787 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.600920 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601112 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601250 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601415 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601555 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601717 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.601847 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602024 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602155 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602325 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602464 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602627 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602758 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.602928 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603067 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603227 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603359 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603536 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603666 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603833 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.603964 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604143 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604273 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604502 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604632 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604758 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.604890 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605066 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605210 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605347 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605473 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605648 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605780 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.605949 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606088 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606247 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606377 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606553 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606684 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.606858 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.607007 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.607165 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.607295 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608018 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608154 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608346 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608493 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608665 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608794 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.608969 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609098 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609290 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609428 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609600 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609737 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.609904 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610041 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610209 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610345 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610510 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610637 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610813 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.610939 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611123 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611252 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611432 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611559 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611740 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.611887 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612047 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612183 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612371 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612514 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612680 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612818 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.612983 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613112 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613296 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613424 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613596 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613733 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.613893 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614020 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614192 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614320 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614495 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614628 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614796 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.614930 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615095 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615225 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615401 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615536 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615701 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.615829 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616007 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616133 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616347 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616479 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616625 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616754 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.616924 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617053 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617231 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617375 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617536 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617669 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617831 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.617960 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618130 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618264 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618441 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618577 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618738 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.618874 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619036 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619180 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619325 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619451 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619623 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619767 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.619926 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620058 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620225 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620372 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620554 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620697 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.620857 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621036 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621164 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621296 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621443 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621587 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621747 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.621884 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622050 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622181 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622350 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622488 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622651 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622779 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.622946 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623093 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623280 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623409 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623578 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623707 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.623880 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624016 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624176 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624359 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624516 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624646 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624824 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.624964 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625124 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625253 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625422 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625550 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625723 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.625861 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626023 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626151 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626326 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626464 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626634 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626774 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.626937 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627074 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627239 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627378 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627541 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627679 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627843 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.627972 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628143 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628272 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628474 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628776 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.628914 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629080 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629214 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629384 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629525 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629685 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629820 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.629981 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630109 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630280 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630411 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630603 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630732 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.630911 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631048 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631217 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631348 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631534 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631663 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631850 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.631987 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632159 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632288 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632479 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632608 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632787 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.632929 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633129 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633257 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633381 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633506 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633676 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633816 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.633985 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634115 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634284 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634413 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634595 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634733 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.634904 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635034 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635212 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635332 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635517 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635655 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635819 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.635957 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636125 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636255 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636454 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636758 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.636890 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637068 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637195 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637372 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637501 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637674 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637812 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.637981 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.638110 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.638283 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.638416 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639099 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639235 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639424 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639552 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639736 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.639865 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640048 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640176 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640377 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640524 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640693 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.640824 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641004 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641134 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641310 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641452 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641634 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641763 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.641946 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642075 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642248 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642386 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642556 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642684 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642861 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.642991 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643173 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643312 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643476 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643606 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643825 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.643961 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644127 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644267 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644459 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644598 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644780 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.644904 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645081 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645221 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645380 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645509 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645681 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645811 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.645998 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.646129 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.646300 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.646428 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.646612 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.646741 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647012 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647141 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647317 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647446 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647619 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647749 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.647920 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648049 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648226 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648448 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648577 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648722 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.648878 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649015 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649182 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649312 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649487 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649634 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649791 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.649927 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650112 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650248 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650416 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650555 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650732 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.650875 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651059 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651190 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651369 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651499 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651682 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651813 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.651984 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652115 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652322 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652457 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652647 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652794 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.652959 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653090 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653280 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653410 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653663 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653801 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.653971 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.654102 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.654328 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.654965 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655151 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655282 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655477 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655608 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655802 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.655941 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656101 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656231 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656434 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656576 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656737 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.656867 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657039 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657170 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657358 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657489 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657663 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657808 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.657974 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658104 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658282 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658419 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658587 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658726 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.658888 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659018 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659191 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659321 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659509 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659648 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.659944 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660132 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660262 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660465 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660784 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.660916 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661088 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661216 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661396 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661526 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661708 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.661839 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662006 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662307 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662437 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662610 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662749 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.662910 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663039 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663215 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663347 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663534 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663662 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663836 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.663965 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664158 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664290 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664497 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664628 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664803 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.664945 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665125 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665260 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665430 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665560 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665743 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.665880 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666051 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666181 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666359 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666488 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666665 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666808 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.666962 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667090 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667262 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667399 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667569 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667708 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.667872 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668003 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668176 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668337 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668502 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668634 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668809 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.668938 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669109 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669248 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669409 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669540 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669710 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.669865 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670071 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670201 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670374 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670506 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670692 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.670824 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671006 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671134 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671304 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671435 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671605 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671735 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.671906 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672046 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672214 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672377 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672548 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672679 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.672859 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673037 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673165 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673452 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673583 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673758 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.673897 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674071 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674371 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674501 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674683 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674824 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.674991 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675120 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675297 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675428 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675604 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675727 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.675907 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676036 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676223 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676407 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676553 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676682 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676864 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.676994 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.677177 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.677372 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.677512 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.677697 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.677836 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678008 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678138 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678319 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678461 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678631 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678755 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.678944 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679073 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679255 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679386 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679564 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679701 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.679873 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680005 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680208 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680356 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680484 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.680944 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.681135 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.681352 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.681483 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.681685 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.681824 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682004 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682141 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682457 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682641 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682778 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.682950 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683080 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683263 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683398 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683577 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683707 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.683882 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684025 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684191 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684368 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684523 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684667 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684834 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.684965 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685141 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685270 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685449 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685641 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685807 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.685953 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686117 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686248 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686426 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686565 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686732 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.686869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687043 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687173 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687374 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687509 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687659 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687857 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.687990 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688125 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688285 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688453 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688617 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688746 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.688928 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689067 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689236 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689372 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689551 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689745 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.689883 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690057 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690197 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690384 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690523 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690704 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.690834 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691029 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691160 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691341 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691471 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691658 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691797 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.691981 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692110 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692283 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692475 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692619 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692797 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.692929 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693115 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693252 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693434 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693572 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693773 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.693952 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694089 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694270 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694400 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694604 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694744 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.694929 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695066 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695254 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695465 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695604 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695808 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.695933 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696122 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696252 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696467 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696609 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696789 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.696928 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697097 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697230 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697384 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697520 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697696 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697823 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.697994 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698122 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698295 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698439 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698604 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698733 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.698909 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699036 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699209 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699339 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699509 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699733 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.699864 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700079 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700222 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700412 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700550 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700709 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.700847 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.701018 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.701726 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.701863 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.701989 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702181 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702304 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702481 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702650 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702778 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.702905 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703079 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703209 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703382 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703514 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703683 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703821 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.703984 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704112 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704280 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704473 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704604 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704730 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.704898 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705029 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705496 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705625 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705803 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.705931 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706132 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706361 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706499 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706634 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706769 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.706903 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707032 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707157 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707313 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707451 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707608 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707747 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.707911 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708052 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708214 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708401 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708532 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708667 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708839 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.708969 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709142 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709280 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709452 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709601 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709757 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.709895 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710069 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710290 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710435 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710619 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710750 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.710936 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711072 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711266 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711406 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711594 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711722 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.711893 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712021 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712197 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712356 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712524 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712666 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712841 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.712976 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713146 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713284 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713457 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713585 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713761 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.713890 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714068 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714374 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714620 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714752 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.714954 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.715093 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.715259 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.715389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.715814 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.715948 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716120 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716259 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716456 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716588 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716814 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.716947 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717152 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717282 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717442 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717574 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717752 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.717882 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718062 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718193 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718374 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718506 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718685 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718814 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.718994 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719124 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719304 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719433 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719609 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719748 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.719916 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720053 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720217 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720390 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720544 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720685 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.720854 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721043 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721181 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721315 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721444 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721580 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721753 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.721876 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.722065 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.722408 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.722542 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.722723 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.722861 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723038 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723166 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723354 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723493 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723659 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723790 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.723967 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724102 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724277 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724448 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724611 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724740 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.724916 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725045 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725225 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725362 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725550 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725680 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725866 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.725988 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.726174 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.726304 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.726493 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.726795 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.726933 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727097 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727235 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727396 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727527 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727703 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.727841 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728017 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728160 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728405 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728551 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728679 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728805 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.728940 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729075 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729223 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729361 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729526 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729664 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729826 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.729966 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730125 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730255 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730424 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730562 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730729 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.730860 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731027 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731158 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731326 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731465 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731630 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731760 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.731930 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.732059 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.732226 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.732886 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733076 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733208 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733387 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733518 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733688 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733827 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.733988 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734127 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734289 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734426 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734587 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734726 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.734884 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735014 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735184 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735322 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735495 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735626 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735798 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.735929 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736102 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736232 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736424 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736554 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736769 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.736907 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737041 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737168 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737303 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737431 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737605 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737737 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.737909 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738047 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738215 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738354 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738522 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738653 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738826 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.738965 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739128 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739258 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739432 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739561 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739739 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.739878 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740044 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740174 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740369 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740503 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740692 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.740839 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741010 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741138 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741305 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741434 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741621 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741812 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.741946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742075 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742235 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742366 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742545 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742677 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742855 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.742992 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743178 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743314 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743482 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743612 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743790 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.743929 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744097 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744228 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744429 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744560 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744737 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.744866 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745053 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745193 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745362 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745499 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745665 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745795 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.745977 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746181 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746317 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746443 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746596 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746734 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.746915 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747054 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747220 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747349 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747540 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747671 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.747850 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748007 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748213 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748364 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748561 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748692 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.748874 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749008 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749188 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749327 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749508 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749639 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749819 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.749951 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.750132 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.750261 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.750387 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:06:10.750522 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.750753 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.751078 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.751405 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.751718 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.752042 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.752392 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.752744 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.753059 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.753402 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.753730 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.754045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.754359 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.754663 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:06:10.754906 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:06:10.904178 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Registered counter for database nova_api Sep 28 12:06:10.914445 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO dbcounter [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Registered counter for database nova_api Sep 28 12:06:10.925712 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:10.933563 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:10.934639 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_db.sqlalchemy.engines [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:10.941604 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writer thread running {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:10.988766 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.context [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a18cfeac-065c-467a-bfbd-7a49d1a8c790(cell1) {{(pid=105580) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:06:10.992573 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:06:10.993073 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:06:10.994588 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:06:10.995314 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:06:10.995753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:06:10.997706 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.context [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a18cfeac-065c-467a-bfbd-7a49d1a8c790(cell1) {{(pid=105579) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:06:10.997815 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:06:11.000295 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Registered counter for database nova_cell0 Sep 28 12:06:11.002134 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:06:11.002846 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:06:11.004251 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:06:11.004406 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Registered counter for database nova_cell1 Sep 28 12:06:11.005015 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:06:11.005456 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:06:11.007506 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_concurrency.lockutils [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:06:11.009523 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO dbcounter [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Registered counter for database nova_cell0 Sep 28 12:06:11.011859 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.013826 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO dbcounter [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Registered counter for database nova_cell1 Sep 28 12:06:11.014305 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.020638 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_db.sqlalchemy.engines [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.022038 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.022375 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.024357 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_db.sqlalchemy.engines [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.026145 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writer thread running {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.168180 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO dbcounter [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Registered counter for database nova_cell0 Sep 28 12:06:11.175445 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_db.sqlalchemy.engines [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.176027 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writer thread running {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.180053 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writer thread running {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.184900 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO dbcounter [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Registered counter for database nova_cell0 Sep 28 12:06:11.193498 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG oslo_db.sqlalchemy.engines [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:06:11.198195 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writer thread running {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:06:11.516436 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:06:11.523890 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:06:11.525077 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: WARNING keystonemiddleware.auth_token [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:06:11.532958 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: WARNING keystonemiddleware.auth_token [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:06:11.863704 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:06:11.869686 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: WARNING keystonemiddleware.auth_token [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:06:11.871612 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: WARNING keystonemiddleware.auth_token [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:06:11.875856 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555eec0b99c0 pid: 105580 (default app) Sep 28 12:06:11.877567 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: WARNING keystonemiddleware.auth_token [None req-45c92aa2-50bd-4942-b260-65eb04d99c1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:06:11.877935 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:06:11.879102 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Sep 28 12:06:11.879518 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Sep 28 12:06:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:06:11.882966 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555eec0b99c0 pid: 105579 (default app) Sep 28 12:07:32.927443 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:32.928698 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Sep 28 12:07:32.929957 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:32.944960 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_api:SELECT=3 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:32.946136 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_cell0:SELECT=3 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:32.947179 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_cell1:SELECT=3 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:32.947966 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_cell0:SELECT=3 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:33.831757 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-480b4906-fd69-4642-9708-bddc91c620db admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:33.864367 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-480b4906-fd69-4642-9708-bddc91c620db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924892 Sep 28 12:07:33.865421 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 28 12:07:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:07:36.488326 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:36.493401 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c303ea7b-5fac-42b4-b027-f57c6c5a063b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005254 Sep 28 12:07:36.496355 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:36.939892 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-4957ff93-95a8-458d-8603-cd8d464788db admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:36.988410 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-4957ff93-95a8-458d-8603-cd8d464788db admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486675 Sep 28 12:07:36.988962 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:07:37.205589 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-7afe76ac-9991-420c-92a0-f67ebb93a6aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:37.211961 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:37.212976 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:37.213663 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell1:SELECT=3 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:37.214354 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:07:37.277235 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-7afe76ac-9991-420c-92a0-f67ebb93a6aa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279068 Sep 28 12:07:37.278278 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 28 12:07:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:07:39.918781 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-4957ff93-95a8-458d-8603-cd8d464788db admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:39.919766 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-4957ff93-95a8-458d-8603-cd8d464788db admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Sep 28 12:07:39.920232 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:40.560529 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-4060ae4e-5784-4b3f-b838-dff4bc475b63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "id": "d1"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:40.603813 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-4060ae4e-5784-4b3f-b838-dff4bc475b63 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.677258 Sep 28 12:07:40.612440 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:07:40.617575 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-9c51dffe-3835-4ca5-99bf-42e6bee3779e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:40.660930 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-9c51dffe-3835-4ca5-99bf-42e6bee3779e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046474 Sep 28 12:07:40.662074 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 28 12:07:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:07:43.281083 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-4060ae4e-5784-4b3f-b838-dff4bc475b63 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:43.282126 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-4060ae4e-5784-4b3f-b838-dff4bc475b63 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 28 12:07:43.282556 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:43.826250 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-34b4972b-5c8c-4169-91aa-07f2b87897e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:43.848085 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-34b4972b-5c8c-4169-91aa-07f2b87897e8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558620 Sep 28 12:07:43.848734 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:07:43.861012 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-4cc50235-ded9-4a29-8fc4-1ab489247d1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:43.888136 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-4cc50235-ded9-4a29-8fc4-1ab489247d1c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030799 Sep 28 12:07:43.888725 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 28 12:07:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:07:46.479209 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-34b4972b-5c8c-4169-91aa-07f2b87897e8 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:46.480219 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-34b4972b-5c8c-4169-91aa-07f2b87897e8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 28 12:07:46.481124 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:46.894801 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-acdde60f-b340-4815-998e-f20100e5bf19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "name": "ds2G", "swap": 0, "vcpus": 2, "id": "d3"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:46.917740 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-acdde60f-b340-4815-998e-f20100e5bf19 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430469 Sep 28 12:07:46.919062 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:07:46.930727 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-48c6fd05-d376-4568-a5a7-0fcb9860e336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:46.959085 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-48c6fd05-d376-4568-a5a7-0fcb9860e336 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032011 Sep 28 12:07:46.960145 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 28 12:07:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:07:49.706320 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-acdde60f-b340-4815-998e-f20100e5bf19 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:49.707611 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-acdde60f-b340-4815-998e-f20100e5bf19 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Sep 28 12:07:49.708227 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:50.130472 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:50.149736 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435029 Sep 28 12:07:50.150289 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:07:50.165714 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bf731902-fa18-47d3-b0d8-59e79e8cd9ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:50.194433 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-bf731902-fa18-47d3-b0d8-59e79e8cd9ee admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032167 Sep 28 12:07:50.195168 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Wed Sep 28 12:07:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:07:52.782050 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:52.783065 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 28 12:07:52.783464 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:53.186976 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-3e1e63ef-5cc0-44d6-a89b-41e832011db0 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:53.214579 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-3e1e63ef-5cc0-44d6-a89b-41e832011db0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.424966 Sep 28 12:07:53.215709 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 28 12:07:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:07:55.781315 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:55.782471 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-830a7da4-936e-4307-9713-25a52041c51c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 28 12:07:55.783115 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:07:56.171369 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5e85ab47-6102-4104-91e6-789efe221912 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:56.190846 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-5e85ab47-6102-4104-91e6-789efe221912 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.402069 Sep 28 12:07:56.191397 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:07:56.204669 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-35c661a2-dc03-4275-9768-b85684f0c3fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:56.234737 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-35c661a2-dc03-4275-9768-b85684f0c3fb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034732 Sep 28 12:07:56.235305 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 28 12:07:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:07:58.829717 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-5e85ab47-6102-4104-91e6-789efe221912 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:07:58.830741 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-5e85ab47-6102-4104-91e6-789efe221912 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 28 12:07:58.831155 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:07:59.239040 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-e39f7e34-938c-473b-b572-21572cccea92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "disk": 20, "swap": 0}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:59.258231 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-e39f7e34-938c-473b-b572-21572cccea92 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417819 Sep 28 12:07:59.258784 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:07:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 12:07:59.270673 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-db602826-e8d5-445d-803c-3573f069bc06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:07:59.294518 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-db602826-e8d5-445d-803c-3573f069bc06 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027452 Sep 28 12:07:59.295102 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 28 12:07:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:08:01.920767 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-e39f7e34-938c-473b-b572-21572cccea92 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:01.921780 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-e39f7e34-938c-473b-b572-21572cccea92 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 28 12:08:01.922180 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:02.274633 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-b99d506b-0268-4fc6-b37d-83e31a409cbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:02.298047 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-b99d506b-0268-4fc6-b37d-83e31a409cbb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.369655 Sep 28 12:08:02.298634 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:08:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:02.311704 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-51aeec3d-45ff-4684-b7af-03d354807088 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:02.347743 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-51aeec3d-45ff-4684-b7af-03d354807088 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040527 Sep 28 12:08:02.348591 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 28 12:08:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:08:05.064032 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-b99d506b-0268-4fc6-b37d-83e31a409cbb admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:05.065038 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-b99d506b-0268-4fc6-b37d-83e31a409cbb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 28 12:08:05.065609 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:05.511437 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-2431ebcb-58b9-4000-b1c9-1d061ad2c239 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:05.517331 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:05.531692 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-2431ebcb-58b9-4000-b1c9-1d061ad2c239 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460123 Sep 28 12:08:05.534290 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:08:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:05.547004 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c9f6f1e6-6f30-4456-a170-62429ce9986c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:05.573286 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c9f6f1e6-6f30-4456-a170-62429ce9986c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032806 Sep 28 12:08:05.574853 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 28 12:08:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:08:08.181920 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-2431ebcb-58b9-4000-b1c9-1d061ad2c239 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:08.183167 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-2431ebcb-58b9-4000-b1c9-1d061ad2c239 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 28 12:08:08.183375 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:08.627728 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "disk": 160}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:08.638235 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:08.650583 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459546 Sep 28 12:08:08.651347 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Wed Sep 28 12:08:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:08.663341 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-d0a1b5b2-017c-4c4b-8a84-dcf07b77fc3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:08.692360 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-d0a1b5b2-017c-4c4b-8a84-dcf07b77fc3c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032775 Sep 28 12:08:08.692939 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Wed Sep 28 12:08:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:08:28.666692 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:28.668256 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Sep 28 12:08:28.668720 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:28.679273 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:08:29.055728 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-557237e1-428b-414e-834e-dfdd89191f48 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:29.074658 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-557237e1-428b-414e-834e-dfdd89191f48 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399810 Sep 28 12:08:29.075184 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 28 12:08:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:30.390117 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:30.391145 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-ede983a7-2600-4a92-a637-cabe456e6d75 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 28 12:08:30.391537 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:30.936072 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-19747ddc-2cb5-43d9-8aa7-be793ce13d3b admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:30.941322 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.wsgi [None req-19747ddc-2cb5-43d9-8aa7-be793ce13d3b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-19747ddc-2cb5-43d9-8aa7-be793ce13d3b admin admin] Request method failure captured: Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept: application/json Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept-Encoding: gzip, deflate Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Connection: keep-alive Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Content-Length: 0 Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Host: 10.222.0.26 Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-System-Scope: None Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: User-Agent: python-novaclient Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Auth-Token: gAAAAABjNDk-PwnJ_FagYiUXiEo0HvJxnVE4Wbgu7EEewMbdfx9EDCe4fkQT2r1o-bkh2f9-L-KE4rRStO6B1KZXW4aHuw6pH_zPiSH7-8n4yvRsyH6Dz4WqvuNhtQ50afmL1YvbG0U-C_yHPwlEPZgwsvue_2xvfU-BhJP7dQ8qG-iVjZWxz7I Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Id: None Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Name: None Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Identity-Status: Confirmed Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Is-Admin-Project: True Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Id: default Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Name: Default Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Name: admin Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Role: reader,member,admin Sep 28 12:08:30.944610 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Roles: reader,member,admin Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant: admin Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Name: admin Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User: admin Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Id: default Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Name: Default Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Name: admin Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: method: > Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: exception: Flavor 42 could not be found. Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: action_args: {'id': '42'} Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:30.946199 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:30.947327 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:30.949513 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-19747ddc-2cb5-43d9-8aa7-be793ce13d3b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:30.950737 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-19747ddc-2cb5-43d9-8aa7-be793ce13d3b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400348 Sep 28 12:08:30.950737 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 28 12:08:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:30.955794 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-539eed76-4e7f-41e9-b985-020ac8af1f02 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:30.979069 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-539eed76-4e7f-41e9-b985-020ac8af1f02 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026786 Sep 28 12:08:30.980117 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:30.990584 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-c851cc27-2e1f-47e8-b1f8-db7b79f4d012 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:31.012800 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-c851cc27-2e1f-47e8-b1f8-db7b79f4d012 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026589 Sep 28 12:08:31.013354 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:31.023182 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d3fbebd5-c75f-4d85-9353-5ddc82e5e9db admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:31.028513 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-d3fbebd5-c75f-4d85-9353-5ddc82e5e9db admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d3fbebd5-c75f-4d85-9353-5ddc82e5e9db admin admin] Request method failure captured: Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept: application/json Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Connection: keep-alive Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Content-Length: 0 Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Host: 10.222.0.26 Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjNDk-PwnJ_FagYiUXiEo0HvJxnVE4Wbgu7EEewMbdfx9EDCe4fkQT2r1o-bkh2f9-L-KE4rRStO6B1KZXW4aHuw6pH_zPiSH7-8n4yvRsyH6Dz4WqvuNhtQ50afmL1YvbG0U-C_yHPwlEPZgwsvue_2xvfU-BhJP7dQ8qG-iVjZWxz7I Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Role: reader,member,admin Sep 28 12:08:31.031770 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Roles: reader,member,admin Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant: admin Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User: admin Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Name: admin Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: method: > Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: exception: Flavor 42 could not be found. Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: action_args: {'id': '42'} Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:31.033329 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:31.034394 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:31.035753 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-d3fbebd5-c75f-4d85-9353-5ddc82e5e9db admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:31.036967 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-d3fbebd5-c75f-4d85-9353-5ddc82e5e9db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013905 Sep 28 12:08:31.036967 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 28 12:08:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:32.256991 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-c851cc27-2e1f-47e8-b1f8-db7b79f4d012 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:32.257997 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-c851cc27-2e1f-47e8-b1f8-db7b79f4d012 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 28 12:08:32.258392 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:32.796022 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bef91530-b93c-4ed0-83b9-4dbe1a076f6f admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:32.803754 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-bef91530-b93c-4ed0-83b9-4dbe1a076f6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bef91530-b93c-4ed0-83b9-4dbe1a076f6f admin admin] Request method failure captured: Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept: application/json Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Connection: keep-alive Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Content-Length: 0 Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Host: 10.222.0.26 Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjNDlAE3kVQuuz26KeJW7I5F5qyCWwPbgMzpk-u5i248qcHXJV6whQKeGoPfPSJBQWxlShkSwJzIVNGqocYZWvHWR33rJfqksIYEUfgHVOHBaAJ5Xe25oJ7pswnfYFlHpGkX8uPI1FqgZ_pY9124MLX6u7n0TVNwF1l6N1FK9pAsqIgxg Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Role: reader,member,admin Sep 28 12:08:32.805597 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Roles: reader,member,admin Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant: admin Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User: admin Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Name: admin Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: method: > Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: exception: Flavor 84 could not be found. Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: action_args: {'id': '84'} Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:32.807137 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:32.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.809188 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bef91530-b93c-4ed0-83b9-4dbe1a076f6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:32.810458 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-bef91530-b93c-4ed0-83b9-4dbe1a076f6f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.400891 Sep 28 12:08:32.810458 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 28 12:08:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:32.817212 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-69fbca04-54f3-422a-b448-83ff59d988db admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:32.832638 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-69fbca04-54f3-422a-b448-83ff59d988db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018813 Sep 28 12:08:32.833295 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:32.843792 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-46e43625-f1bc-4567-85c7-6867b5547d4c admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:32.859686 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-46e43625-f1bc-4567-85c7-6867b5547d4c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019746 Sep 28 12:08:32.860235 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:32.869765 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-8bb45e96-ac9d-4cca-8043-fbc3164221ea admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:32.874812 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.wsgi [None req-8bb45e96-ac9d-4cca-8043-fbc3164221ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-8bb45e96-ac9d-4cca-8043-fbc3164221ea admin admin] Request method failure captured: Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept: application/json Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept-Encoding: gzip, deflate Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Connection: keep-alive Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Content-Length: 0 Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Host: 10.222.0.26 Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-System-Scope: None Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: User-Agent: python-novaclient Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Auth-Token: gAAAAABjNDlAE3kVQuuz26KeJW7I5F5qyCWwPbgMzpk-u5i248qcHXJV6whQKeGoPfPSJBQWxlShkSwJzIVNGqocYZWvHWR33rJfqksIYEUfgHVOHBaAJ5Xe25oJ7pswnfYFlHpGkX8uPI1FqgZ_pY9124MLX6u7n0TVNwF1l6N1FK9pAsqIgxg Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Id: None Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Name: None Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Identity-Status: Confirmed Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Is-Admin-Project: True Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Id: default Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Name: Default Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Name: admin Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Role: reader,member,admin Sep 28 12:08:32.876388 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Roles: reader,member,admin Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant: admin Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Name: admin Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User: admin Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Id: default Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Name: Default Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Name: admin Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: method: > Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: exception: Flavor 84 could not be found. Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: action_args: {'id': '84'} Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:32.877946 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:32.879045 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:32.880389 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-8bb45e96-ac9d-4cca-8043-fbc3164221ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:32.881609 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-8bb45e96-ac9d-4cca-8043-fbc3164221ea admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011556 Sep 28 12:08:32.881609 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Sep 28 12:08:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:34.097965 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-46e43625-f1bc-4567-85c7-6867b5547d4c admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:34.098970 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-46e43625-f1bc-4567-85c7-6867b5547d4c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 28 12:08:34.099366 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:34.630280 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-9257f8f0-bdb1-4fb1-9808-e4f26917d303 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:34.636595 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.wsgi [None req-9257f8f0-bdb1-4fb1-9808-e4f26917d303 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-9257f8f0-bdb1-4fb1-9808-e4f26917d303 admin admin] Request method failure captured: Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept: application/json Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Accept-Encoding: gzip, deflate Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Connection: keep-alive Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Content-Length: 0 Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Host: 10.222.0.26 Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Openstack-System-Scope: None Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: User-Agent: python-novaclient Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Auth-Token: gAAAAABjNDlBNhhkRUQ6zFuu28pM4QHoN_bQLZT0kgyxbfDfLisLOwMP3AomGquMQwbFbd0-k2V8SZng9IEcdS3cjkAP6pOyMwBm8cGZx9tWv7UhG2Y8xTJvUZm3VGvXzuz4JEcGfpskQutixTWQmEvrZbTGf8ClrAD_MNGIMWL6dwoobLln0Jc Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Id: None Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Domain-Name: None Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Identity-Status: Confirmed Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Is-Admin-Project: True Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Id: default Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Domain-Name: Default Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Project-Name: admin Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Role: reader,member,admin Sep 28 12:08:34.638083 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Roles: reader,member,admin Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant: admin Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-Tenant-Name: admin Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User: admin Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Id: default Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Domain-Name: Default Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: X-User-Name: admin Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: method: > Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: exception: Flavor 451 could not be found. Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: action_args: {'id': '451'} Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:34.639613 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:34.640599 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.641869 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-9257f8f0-bdb1-4fb1-9808-e4f26917d303 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:34.643067 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-9257f8f0-bdb1-4fb1-9808-e4f26917d303 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.401510 Sep 28 12:08:34.643067 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:08:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:34.649312 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-11de1885-fc7b-471b-8b74-1eadd61810dc admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:34.664630 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-11de1885-fc7b-471b-8b74-1eadd61810dc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018862 Sep 28 12:08:34.665147 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:08:34.674254 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:34.688878 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018106 Sep 28 12:08:34.689407 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Sep 28 12:08:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:08:34.698968 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-35df63f6-7e72-47d4-86eb-f1f5361515fb admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:34.703773 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.wsgi [None req-35df63f6-7e72-47d4-86eb-f1f5361515fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-35df63f6-7e72-47d4-86eb-f1f5361515fb admin admin] Request method failure captured: Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept: application/json Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Accept-Encoding: gzip, deflate Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Connection: keep-alive Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Content-Length: 0 Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Host: 10.222.0.26 Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-Api-Version: compute 2.92 Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Openstack-System-Scope: None Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: User-Agent: python-novaclient Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Auth-Token: gAAAAABjNDlBNhhkRUQ6zFuu28pM4QHoN_bQLZT0kgyxbfDfLisLOwMP3AomGquMQwbFbd0-k2V8SZng9IEcdS3cjkAP6pOyMwBm8cGZx9tWv7UhG2Y8xTJvUZm3VGvXzuz4JEcGfpskQutixTWQmEvrZbTGf8ClrAD_MNGIMWL6dwoobLln0Jc Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Id: None Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Domain-Name: None Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Identity-Status: Confirmed Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Is-Admin-Project: True Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Id: default Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Domain-Name: Default Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Project-Name: admin Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Role: reader,member,admin Sep 28 12:08:34.705298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Roles: reader,member,admin Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d6b5c1f82154555b8d48a213cdda1ed", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d6b5c1f82154555b8d48a213cdda1ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant: admin Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Id: 8d6b5c1f82154555b8d48a213cdda1ed Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-Tenant-Name: admin Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User: admin Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Id: default Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Domain-Name: Default Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Id: f82a94e2366b45ff82ac58061224a3a2 Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: X-User-Name: admin Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: method: > Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: exception: Flavor 451 could not be found. Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: action_args: {'id': '451'} Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:08:34.706812 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:34.707818 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: ERROR nova.api.openstack.wsgi Sep 28 12:08:34.708891 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-35df63f6-7e72-47d4-86eb-f1f5361515fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:08:34.709937 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-35df63f6-7e72-47d4-86eb-f1f5361515fb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011693 Sep 28 12:08:34.709937 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:08:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 12:08:35.954649 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:35.956015 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 28 12:08:35.956447 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:36.475605 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-44359b20-951c-4764-9e11-b2c5db5036b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:36.496621 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-44359b20-951c-4764-9e11-b2c5db5036b3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397069 Sep 28 12:08:36.497171 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 28 12:08:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:37.709765 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:37.710789 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 28 12:08:37.711190 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:38.247384 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-9e6124ce-11ad-4352-b9e1-2c036e3bfa9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:38.265298 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-9e6124ce-11ad-4352-b9e1-2c036e3bfa9e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.411351 Sep 28 12:08:38.265767 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 28 12:08:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:39.488766 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:39.489805 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 28 12:08:39.490200 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:40.007496 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-148371b7-4260-4ba9-9e5d-1ea285764ba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:40.026473 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-148371b7-4260-4ba9-9e5d-1ea285764ba9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398401 Sep 28 12:08:40.027016 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 28 12:08:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:41.249266 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:41.250387 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 28 12:08:41.250779 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:41.764839 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-7355f106-5c34-44e4-bcfa-a15a3784d09d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:08:41.783541 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-7355f106-5c34-44e4-bcfa-a15a3784d09d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.392743 Sep 28 12:08:41.784086 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Sep 28 12:08:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:08:42.989174 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:42.990174 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 28 12:08:42.990592 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:08:43.506183 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-3cddd13a-3530-4f00-9391-3eb3057cf961 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:08:43.526766 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-3cddd13a-3530-4f00-9391-3eb3057cf961 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399087 Sep 28 12:08:43.527310 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Sep 28 12:08:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:09:40.035106 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.036125 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-43eaab37-4075-4d12-adb8-30a6c0c05115 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 28 12:09:40.036575 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:09:40.047543 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.421158 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-7dae1f8e-837d-43c6-87ea-1d4bfbb525f6 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.441140 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-7dae1f8e-837d-43c6-87ea-1d4bfbb525f6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398127 Sep 28 12:09:40.441672 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:09:40.463548 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_api:SELECT=14 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:09:40.467567 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-b9200632-32be-4361-991e-43653aad676a admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.474801 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-b9200632-32be-4361-991e-43653aad676a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012653 Sep 28 12:09:40.475311 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:40.487526 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-bd7838ae-3871-4912-b808-bc0ce46cc6af admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.494804 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-bd7838ae-3871-4912-b808-bc0ce46cc6af admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010824 Sep 28 12:09:40.495326 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:40.506799 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.514002 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010794 Sep 28 12:09:40.514515 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:09:40.525867 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-cb6f6e5d-7dbc-406d-885a-6361ac611d3d admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:09:40.532772 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-cb6f6e5d-7dbc-406d-885a-6361ac611d3d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010842 Sep 28 12:09:40.533274 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Wed Sep 28 12:09:40 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:12:43.035201 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:43.036201 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 28 12:12:43.036638 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:12:43.176393 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=6 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:43.332726 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:43.337408 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:43.337871 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:43.338289 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:43.338988 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:43.339420 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:43.339829 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:43.371809 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-2c44f0e4-061d-4181-8ae8-9ee66cb27008 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196695 Sep 28 12:12:43.372368 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:12:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:12:44.479741 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:44.480788 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 28 12:12:44.481179 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:12:44.668794 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:44.672181 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:44.672817 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:44.673166 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:44.673866 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:44.674302 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:44.674710 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:44.693501 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-fc045dd6-ec0e-4512-9e75-9a700d9d5e31 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075206 Sep 28 12:12:44.694048 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:12:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:12:56.247508 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:56.248546 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 28 12:12:56.248941 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:12:56.392473 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell0:SELECT=4 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:56.393184 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_cell1:SELECT=4 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:56.393857 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG dbcounter [-] [105580] Writing DB stats nova_api:SELECT=8 {{(pid=105580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:12:56.445670 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:56.449079 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:56.449581 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:56.450006 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:56.450711 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:56.451150 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:56.451562 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:56.477448 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-c4119cfb-f6f1-4a35-a32c-c4f39739fab6 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.089815 Sep 28 12:12:56.477921 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:12:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:12:57.565465 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG nova.api.openstack.wsgi [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] Calling method '>' {{(pid=105579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:57.566526 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: INFO nova.api.openstack.requestlog [None req-fa0eac9e-dfeb-46e6-bd3d-6229cd4ec564 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 28 12:12:57.566920 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: [pid: 105579|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Sep 28 12:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:12:57.767979 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG nova.api.openstack.wsgi [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Calling method '>' {{(pid=105580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:12:57.771347 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:57.771824 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:57.772250 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:57.772993 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:12:57.773466 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:12:57.773879 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: DEBUG oslo_concurrency.lockutils [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:12:57.795386 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: INFO nova.api.openstack.requestlog [None req-92536d42-9bfe-46a3-a4b1-7ee91442f459 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078338 Sep 28 12:12:57.795928 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: [pid: 105580|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Sep 28 12:12:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:13:54.712760 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: Wed Sep 28 12:13:54 2022 - graceful shutdown triggered... Sep 28 12:13:54.712891 dv-cinder-859193-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 12:13:54.713879 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: Gracefully killing worker 1 (pid: 105579)... Sep 28 12:13:54.714324 dv-cinder-859193-2-iscsi devstack@n-api.service[105580]: Gracefully killing worker 2 (pid: 105580)... Sep 28 12:13:54.839829 dv-cinder-859193-2-iscsi devstack@n-api.service[105579]: DEBUG dbcounter [-] [105579] Writing DB stats nova_api:SELECT=4 {{(pid=105579) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:13:55.714941 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: worker 1 buried after 1 seconds Sep 28 12:13:55.714941 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: worker 2 buried after 1 seconds Sep 28 12:13:55.714941 dv-cinder-859193-2-iscsi devstack@n-api.service[105578]: goodbye to uWSGI. Sep 28 12:13:55.716560 dv-cinder-859193-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 12:13:55.717110 dv-cinder-859193-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 12:13:55.720144 dv-cinder-859193-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 12:13:55.733911 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 12:13:55 2022] *** Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: nodename: dv-cinder-859193-2-iscsi Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: machine: x86_64 Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: clock source: unix Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: pcre jit disabled Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: detected number of CPU cores: 4 Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: current working directory: / Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: detected binary path: /usr/bin/uwsgi-core Sep 28 12:13:55.737532 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: your processes number limit is 47680 Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: your memory page size is 4096 bytes Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: detected max file descriptor number: 2048 Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: lock engine: pthread robust mutexes Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: thunder lock: enabled Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 12:13:55.738379 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 12:13:55.777569 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: Python main interpreter initialized at 0x5611f87279c0 Sep 28 12:13:55.777569 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: python threads support enabled Sep 28 12:13:55.777569 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: your server socket listen backlog is limited to 100 connections Sep 28 12:13:55.777569 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: your mercy for graceful operations on workers is 90 seconds Sep 28 12:13:55.777990 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 12:13:55.777990 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: *** Operational MODE: preforking *** Sep 28 12:13:55.778202 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: *** uWSGI is running in multiple interpreter mode *** Sep 28 12:13:55.778202 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: spawned uWSGI master process (pid: 120618) Sep 28 12:13:55.778406 dv-cinder-859193-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 12:13:55.780480 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: spawned uWSGI worker 1 (pid: 120636, cores: 1) Sep 28 12:13:55.780480 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: spawned uWSGI worker 2 (pid: 120637, cores: 1) Sep 28 12:13:55.780480 dv-cinder-859193-2-iscsi devstack@n-api.service[120618]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 12:13:56.435152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:13:56.437137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 12:13:57.592339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:57.592339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 28 12:13:57.593186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:57.593186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: from cryptography.utils import int_from_bytes Sep 28 12:13:57.593546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:57.593546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: from cryptography.utils import int_from_bytes Sep 28 12:13:57.594042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 12:13:57.594042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: from cryptography.utils import int_from_bytes Sep 28 12:14:00.000586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:14:00.001326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:14:00.001423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:14:00.001749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:14:00.002011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:14:00.002405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.002740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.003063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.003385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.003722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.004038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.004388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.004716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.005047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.005313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.005632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.006130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-2-iscsi {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.006469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.006786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.007217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.007433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.007745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.008077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.008448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.008936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.010317 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.010317 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.010317 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.010683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.010947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.011277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.011598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.011927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.012246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.012830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.013439 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-2-iscsi {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.013961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.014467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.014997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.015434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.015789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.016105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.016463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.016796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.017122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.017471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.017803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.018123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.018452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.018761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.019075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.019393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.019717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.020028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.020360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.020619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.020943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.021256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.021582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.021907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.022162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.022420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.022751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.023075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.023385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.023695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.024004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.024342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.024455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 12:14:00.024909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.025004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 12:14:00.025089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.025187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 12:14:00.025272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.025529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.025642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 12:14:00.025787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 12:14:00.025907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.026882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.027851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.028861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859193-2-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.029990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.030930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.031032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.031834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.031935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.032150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.032253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.032431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.032538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.032744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.033961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.034896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.035933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859193-2-iscsi {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.036923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.037880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038344 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.038923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.039158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.044527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.044527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.044873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.045937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.046729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.047913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.048968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.049944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.050920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.051390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.051575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.051774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.051870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.051994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.052077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.052156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.052237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.052397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.052494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.052568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.052668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.052749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.052868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.052968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.053061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.053155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.053239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.053331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.053422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.053515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.053609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.053700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.054097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.054272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.054450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.054623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.054803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.054933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.055030 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.055161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.055254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.055340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.055413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.055483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.055559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.055648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.055719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.055937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.056038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.056241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.056359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.056581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.056673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.056927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.057034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.057180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.057326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.057708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.057862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.057972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.058076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.058163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.058277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.058381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.058506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.058716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.058846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.058995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.059103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.059306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.059430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.059643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.059764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.059956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.060060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.060267 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.060430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.060599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.060692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.060910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.061010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.061221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.061313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.061547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.061646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.061858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.061955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.062168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.062258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.062535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.062637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.062850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.062949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.063168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.063260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.063484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.063580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.063790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.063909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.064102 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.064217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.064447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.064552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.064755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.065104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.065104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.065266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.065357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.065442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.065653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.065772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.065970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.066081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.066273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.066374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.066580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.066672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.066891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.066982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.067203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.067305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.067510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.067604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.067819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.067919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.068123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.068258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.068461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.068554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.068779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.068878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.069090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.069180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.069401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.069493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.069713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.069817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070015 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 12:14:00.070345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.070971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.071922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.072916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.073973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.074923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.075886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.076860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.077809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.078537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.078671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.078856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.079929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.080834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.081934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.082083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.082235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.082540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.082892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.083235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.083564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.083894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.084228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.084572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.084687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.084773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.084945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.085894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.086166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.086264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.086448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.086773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.087087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.087396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.087566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.087717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.087879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.088786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.089993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.090944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.091889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.092887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.093393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.093484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.093806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.093912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094451 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.094896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.095863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.096892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097324 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.097922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.098868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.099898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.100870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.101832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.102791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103102 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.103968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.104919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.105957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.106884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.107115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.107433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.107747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.107925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.108946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.109128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.109816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.109977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.110306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.110626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112629 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.112929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.113838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.114991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.115998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.116988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.117940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.118966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.119909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.120141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.120236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.120486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.120570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.121792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.122948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.123985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.124387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.124477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.124558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.124636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.124890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.125492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.125744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.125827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.126793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.127021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.127102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.127347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.128910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129821 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.129958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.130888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.131029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.131120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.131340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.131421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.131715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.132932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.133957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.134095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.134239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.134375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.134523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.135710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.135874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.135972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.136936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.137870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.138865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.139759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.140865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.141897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.142971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.143921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.144915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.145846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.146789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147339 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.147965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.148932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.149975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.150201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.150289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.150530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.150622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.151987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.152978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.153879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.154925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.155821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.156851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.157973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158790 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.158941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.159849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.160835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.161946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.162923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.163977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.164924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.165067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.165216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.165368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.165511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.165667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.166329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.166329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.166650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.166804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.166956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.167858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.168865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.169910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.170981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.171227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.171389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.171533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.171683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.172486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.172647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.172801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.172945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.173985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.174969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.175995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.176169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.176420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.176588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.176742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.176885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.177937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.178092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.178235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.179931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.180916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.181986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.182982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.183859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.184993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.185879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.186928 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.187072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.187223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.187413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.188966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.189975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.190917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.191911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.192201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.192377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.192535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.192800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.192952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.193874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.194927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.195973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.196122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.196265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.196455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.196633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.196856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.197748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.198762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.199884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.200855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.201790 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.202767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.203953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.204889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.205951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.206859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.207853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208629 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.208929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209230 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.209929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.210947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.211226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.211394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.211539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.211689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.211840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.212912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.213915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.214941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.215991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.216780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.217080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.217301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.217458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.217611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.217763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.218207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.218357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.218502 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.218706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.218877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.219872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.220831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.221121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.221304 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.221483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.221671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.221850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.222045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.222341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.222526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.222717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.222897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.223176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.223176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.223543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.223732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.223918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.224184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.224404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.224579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.224726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.224879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.225926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.226882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.227924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.228088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.228246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.228441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.228599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.228861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.229893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.230916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.231916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.232964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.233142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.233142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.233543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.233702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.233853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.234010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.234171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.234851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.235965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.236129 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.236379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.236563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.236726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.236877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.237900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.238984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.239912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.240061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.240387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.240551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.240709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.240862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.241847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.242918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.243218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.243218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.243593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.243749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.243907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.244175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.244480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.244641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.244641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.244936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.245871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.246957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.247996 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.248148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.248298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.248520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.248672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.249992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.250157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.250335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.250558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.250777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.250941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.251942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.252093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.252252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.252454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.252606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.252785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.253923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.254990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.255312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.255471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.255622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.255771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.255927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.256882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.257042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.257192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.257352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.257508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.257666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.258924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.259939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.260967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.261940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.262963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.263994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.264990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.265967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.266057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.266131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.266652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.267840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.268971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.269906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.270990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.271138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.271306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:14:00.271602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.271602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.271602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.271602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.272208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.272208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.272563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.272802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.273112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.273421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.273730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.274040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.274336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.274645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.274955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.275261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.275575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.275885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.276200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.276554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.276867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.277177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.277487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.277794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.278132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.278478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.278797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.279125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.279443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.279770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.280085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.280504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.280766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.281114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.281492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.281835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.282154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.282519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.282787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.283108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.283427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.283744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.284081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.284729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.284729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.285071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.285397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.285730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.286053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.286370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.286706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.287022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.287339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.287654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.287968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.288283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.288627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.288943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.289258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.289578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.289900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.290233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.290566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.290884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.291217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.291549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.291903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.292222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.292624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.292927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.293248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.293564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.293876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 12:14:00.294194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 12:14:00.333134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO dbcounter [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Registered counter for database nova_api Sep 28 12:14:00.353870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_db.sqlalchemy.engines [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.361363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writer thread running {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.363993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Registered counter for database nova_api Sep 28 12:14:00.384214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.390825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.417128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.context [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a18cfeac-065c-467a-bfbd-7a49d1a8c790(cell1) {{(pid=120636) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:14:00.421146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:00.421617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:00.424056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:00.424971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:00.425418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:00.427416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:00.429428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO dbcounter [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Registered counter for database nova_cell0 Sep 28 12:14:00.433450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO dbcounter [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Registered counter for database nova_cell1 Sep 28 12:14:00.441546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_db.sqlalchemy.engines [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.443325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_db.sqlalchemy.engines [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.449543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writer thread running {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.450321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.context [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a18cfeac-065c-467a-bfbd-7a49d1a8c790(cell1) {{(pid=120637) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 12:14:00.451640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writer thread running {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.454607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:00.455087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:00.456719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:00.457448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:00.457895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:00.459951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:00.461952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Registered counter for database nova_cell0 Sep 28 12:14:00.466023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Registered counter for database nova_cell1 Sep 28 12:14:00.474005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.476156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.480879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.483489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.618296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO dbcounter [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Registered counter for database nova_cell0 Sep 28 12:14:00.626002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_db.sqlalchemy.engines [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.631728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writer thread running {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.637691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO dbcounter [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Registered counter for database nova_cell0 Sep 28 12:14:00.644976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_db.sqlalchemy.engines [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 12:14:00.649530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writer thread running {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 12:14:00.952843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: WARNING keystonemiddleware.auth_token [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:00.960793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: WARNING keystonemiddleware.auth_token [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:00.971136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:00.978449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:01.306753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: WARNING keystonemiddleware.auth_token [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:01.313496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: WARNING keystonemiddleware.auth_token [None req-38bdbe68-b818-402b-9398-111d2bd18af6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:01.318908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611f87279c0 pid: 120636 (default app) Sep 28 12:14:01.326520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 12:14:01.333096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: WARNING keystonemiddleware.auth_token [None req-5e64a6b4-8cec-4b50-9fa1-7dd8795751c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 12:14:01.338342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611f87279c0 pid: 120637 (default app) Sep 28 12:14:48.318446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:48.319687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:48.324523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:48.327480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:49.457273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029739356", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:14:50.691808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] validate_networks() for [('404aaa5f-056d-4dc4-97e2-ab689c5dc016', None, None, None, None, None)] {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:14:52.584041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:14:52.584857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:14:52.585585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:14:52.586107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:14:52.586637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:14:52.643668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:52.650242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:52.653885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:52.660558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:52.662471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:52.663569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:52.767172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Getting quotas for project 47157b4286ac4ed5a24ba31bafd206a2. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:14:52.784045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Getting quotas for user 956c7f92a4a747dba49e3f3a527bba74 and project 47157b4286ac4ed5a24ba31bafd206a2. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:14:52.818356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:14:52.823468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:14:52.972987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-47c2f7cd-8742-4dd9-a0cb-927423057c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.660378 Sep 28 12:14:52.983822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:14:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 4673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:14:52.990638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.992250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:52.999953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:53.005569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:14:53.752498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a596a2f9-859b-496a-a4bd-19b575d93635 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:14:53.754153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a596a2f9-859b-496a-a4bd-19b575d93635 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:14:55.320540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0ec85f79-e970-4d5d-8877-9d9c2b2c40a8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Action: 'create', calling method: .version_select at 0x7f3062b5b430>, body: {"keypair": {"name": "tempest-keypair-976601085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5XtbIERpFUtnIQXbvwWEmnzs051R/z5Wn+SYLxm5yjGaSpowra05NJIAHtalm9xgEIVws5IRgBBYSCe9F9NX1mAia0oeMS1YQmCr+O5nVH/JDgKtTyBUJFrT8pMr30aw=="}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:14:55.388232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-0ec85f79-e970-4d5d-8877-9d9c2b2c40a8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:14:55.395134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-0ec85f79-e970-4d5d-8877-9d9c2b2c40a8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for user fdb0f345d2e04483b5166e1eb728bf91 and project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:14:55.452289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a596a2f9-859b-496a-a4bd-19b575d93635 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:14:55.488751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a596a2f9-859b-496a-a4bd-19b575d93635 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1222 microversion: 2.1 time: 2.503932 Sep 28 12:14:55.489846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1/2] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:14:52 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1222 bytes in 2508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:14:55.506979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0ec85f79-e970-4d5d-8877-9d9c2b2c40a8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.329836 Sep 28 12:14:55.513158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:14:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:14:55.741191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1336820804", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:14:56.012530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] validate_networks() for [('404aaa5f-056d-4dc4-97e2-ab689c5dc016', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:14:56.851385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-632087354", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "networks": [{"uuid": "347310a7-1de4-4b8e-95c5-d89104245602"}]}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:14:56.971869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] validate_networks() for [('347310a7-1de4-4b8e-95c5-d89104245602', None, None, None, None, None)] {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:14:58.096142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:14:58.097432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:14:58.099026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:14:58.099243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:14:58.099837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:14:58.123148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:58.124014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:58.124714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:58.125728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:58.126370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:58.128219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:58.195296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Getting quotas for project 47157b4286ac4ed5a24ba31bafd206a2. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:14:58.205034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Getting quotas for user 956c7f92a4a747dba49e3f3a527bba74 and project 47157b4286ac4ed5a24ba31bafd206a2. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:14:58.246933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:14:58.249931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:14:58.270202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:14:58.270787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:14:58.271084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:14:58.271657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:14:58.272222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:14:58.291793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:58.292328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:58.293586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:58.294559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:14:58.297007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:14:58.297687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:14:58.354834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Getting quotas for project 6090ef3dd4494004b0156e49bbeb9273. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:14:58.360805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Getting quotas for user 3b0e4c6131674b3799a374aacdec708f and project 6090ef3dd4494004b0156e49bbeb9273. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:14:58.392114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:14:58.397166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:14:58.458744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b90b5a9e-cd99-4dda-8c33-5a7f6cc07b67 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.723950 Sep 28 12:14:58.459325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 2/4] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:14:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:14:58.544552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-832ab951-bf89-4fda-a107-4896b4414267 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.939220 Sep 28 12:14:58.545273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 3/5] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:14:58.560032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b335cc81-41ea-4fda-98d7-786df26646f6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:14:58.566301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b335cc81-41ea-4fda-98d7-786df26646f6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:14:58.640858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9084e87f-06ae-46d5-99bf-a8bbde6ac8bf tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: .version_select at 0x7f3062af5d30>, body: {"keypair": {"name": "tempest-keypair-2031298439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI2O9SPOBxXadBnyxzA/1PLvjudp48jzlSBwiOJ374mFABeNC4lPui9JYU+Ordy0H++b1mKXSB8yj/RUKbjOnzuCYwB8PO6mMIF1kkGbxMGTSvT8dEswE/LZBK4oTPATA=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:14:58.690943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9084e87f-06ae-46d5-99bf-a8bbde6ac8bf tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:14:58.695503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9084e87f-06ae-46d5-99bf-a8bbde6ac8bf tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:14:58.768878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9084e87f-06ae-46d5-99bf-a8bbde6ac8bf tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308233 Sep 28 12:14:58.770106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 3/6] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:14:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:14:58.781942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5fa20911-9211-4e42-9da5-7c76194477e7 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:14:58.782760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5fa20911-9211-4e42-9da5-7c76194477e7 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:14:58.905710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b335cc81-41ea-4fda-98d7-786df26646f6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:14:58.937824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b335cc81-41ea-4fda-98d7-786df26646f6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1222 microversion: 2.1 time: 0.391461 Sep 28 12:14:58.939572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:14:58 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1222 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:14:59.063064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5fa20911-9211-4e42-9da5-7c76194477e7 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:14:59.080945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5fa20911-9211-4e42-9da5-7c76194477e7 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1214 microversion: 2.1 time: 0.306972 Sep 28 12:14:59.083312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:14:58 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:14:59.967632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a36976c-2582-4670-9db2-11a666bb5cd1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:14:59.968372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a36976c-2582-4670-9db2-11a666bb5cd1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:00.108603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:00.110026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:00.139462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:00.142413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:00.146699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:00.148263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:00.154045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:00.157136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:00.452081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4a36976c-2582-4670-9db2-11a666bb5cd1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:00.464658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a36976c-2582-4670-9db2-11a666bb5cd1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1222 microversion: 2.1 time: 0.502300 Sep 28 12:15:00.475677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:14:59 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1222 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:00.979812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:01.031060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c9fbb33-eee3-4aad-b876-ca4c09872ccc tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1210 microversion: 2.1 time: 0.922170 Sep 28 12:15:01.041692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8cb62167-7f79-49d9-a9e6-60894ea3b3cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Action: 'create', calling method: .version_select at 0x7f3062b0d550>, body: {"keypair": {"name": "tempest-keypair-266835590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuKJdwUCt5vxV5s/3TDG3OevpXxx8sqEtBfUxSvxH6HEDeMbL++H9ppzoiUhUZCJ77An3PzQklnHh5A9gbgb/HEP3LH7p4aAR2MHXjK1a9HL9DD3g4ieJrniDSeYXMTdg=="}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:01.044453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:00 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1210 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:01.090590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-8cb62167-7f79-49d9-a9e6-60894ea3b3cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for project ba288a6bdc4e41729bd679733eaee61e. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:15:01.111546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-8cb62167-7f79-49d9-a9e6-60894ea3b3cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for user 820f4bb963644499a77fa1f3edd59d08 and project ba288a6bdc4e41729bd679733eaee61e. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:15:01.193454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8cb62167-7f79-49d9-a9e6-60894ea3b3cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.641042 Sep 28 12:15:01.197179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 6/11] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Sep 28 12:15:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 649 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 12:15:01.499084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:01.500188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:01.515239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:01.524953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:01.527591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:01.532437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:01.532955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:01.538225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:01.959388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:01.983203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9b53e56-673e-4512-94e3-d2e2ad0a8a7a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1218 microversion: 2.1 time: 0.486644 Sep 28 12:15:01.984742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:01 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1218 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:02.058114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:02.058739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:02.080088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:02.080622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:02.081096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:02.081832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:02.082359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:02.092844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:02.353338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-576360384", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d98253-7d06-4089-91c8-50499176172f"}], "security_groups": [{"name": "tempest-securitygroup--668945471"}], "key_name": "tempest-keypair-976601085", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:02.656361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:02.689308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0fe2194c-6c00-4fa7-b27e-ab14888adc16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 0.630499 Sep 28 12:15:02.727633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:02 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:03.021649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:03.024106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:03.043749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:03.044253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:03.048292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:03.049234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:03.049716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:03.053083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:03.241079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:03.270778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b038e2f-713f-47d4-93cb-4675e79c121d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1274 microversion: 2.1 time: 0.264083 Sep 28 12:15:03.282726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:03 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:03.390879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] validate_networks() for [('35d98253-7d06-4089-91c8-50499176172f', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:15:03.737236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:03.738114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:03.759710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:03.764479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:03.766818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:03.767893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:03.773249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:03.779338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:03.959944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:03.973482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8cfa6f85-5da5-4609-84bd-355e5a0a02d1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 0.240742 Sep 28 12:15:03.976156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 9/15] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:03 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:04.302166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:04.303451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:04.316841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:04.318628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:04.319319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:04.321961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:04.323176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:04.324685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:04.531306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:04.543170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e849656c-5751-4361-83f1-3f1b9eea2442 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1274 microversion: 2.1 time: 0.246206 Sep 28 12:15:04.564996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 10/16] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:04 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:04.564996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-160289209", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61173ad2-9eff-4ab1-9b46-07b6bca945cf"}], "security_groups": [{"name": "tempest-securitygroup--560066758"}], "key_name": "tempest-keypair-2031298439", "user_data": "}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:04.741167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] validate_networks() for [('61173ad2-9eff-4ab1-9b46-07b6bca945cf', None, None, None, None, None)] {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:15:05.235164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:15:05.235762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:15:05.236039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:15:05.236484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:15:05.237079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:15:05.254865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.255600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.256177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.257083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.257706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.258118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.303880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:15:05.307958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for user fdb0f345d2e04483b5166e1eb728bf91 and project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:15:05.330976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:15:05.333224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:15:05.427059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ce5b88c-96a8-4525-9f03-43b82db5c845 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.075984 Sep 28 12:15:05.430015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 7/17] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:15:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:15:05.438289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:05.449582 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:05.479543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.480035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.480510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.481214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.481666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.482092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.505349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:15:05.506906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:15:05.507634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:15:05.508259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:15:05.508894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:15:05.525988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.526706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.527359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.529515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.530827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.531657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.629835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:15:05.646242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:15:05.688453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:15:05.691226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:15:05.718301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:05.731899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eec92d2c-c588-4cb3-a432-38edab576484 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 0.296043 Sep 28 12:15:05.744988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 8/18] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:05 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:05.761012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-869ae27f-57a6-4e94-8e2a-0464960f6d4b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:05.761603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-869ae27f-57a6-4e94-8e2a-0464960f6d4b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:05.860948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2a42084d-08ae-49d9-89ac-ca1304a58f79 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.308152 Sep 28 12:15:05.866609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 11/19] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:15:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:15:05.873637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:05.887251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:05.910017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.910771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.911382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.917697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:05.921220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:05.922019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:05.923635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-869ae27f-57a6-4e94-8e2a-0464960f6d4b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:05.934416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-869ae27f-57a6-4e94-8e2a-0464960f6d4b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1236 microversion: 2.1 time: 0.186596 Sep 28 12:15:05.935317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 9/20] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:05 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1236 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:05.944439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-abb38ac9-a2ac-4f04-be35-35ac8b4c773c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:05.957740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-abb38ac9-a2ac-4f04-be35-35ac8b4c773c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:06.104423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-abb38ac9-a2ac-4f04-be35-35ac8b4c773c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:06.114540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-abb38ac9-a2ac-4f04-be35-35ac8b4c773c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1241 microversion: 2.1 time: 0.175610 Sep 28 12:15:06.116853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:06.128445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:05 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:06.140718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2dfbcb50-dd03-4343-998e-4b6041d0cd40 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1274 microversion: 2.1 time: 0.272428 Sep 28 12:15:06.141318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:05 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:06.759237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:06.760538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:06.773555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:06.780331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:06.783246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:06.784013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:06.784555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:06.785207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:06.961534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:06.962885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:06.979184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:06.980139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:06.980939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:06.985469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:06.986895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:06.990039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:07.155072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:07.171440 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0efb08b4-47ee-4a0b-9535-d34e4fd03ca4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1240 microversion: 2.1 time: 0.215873 Sep 28 12:15:07.175629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 13/23] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:06 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:07.194602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:07.195918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:07.218183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:07.223399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:07.224921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:07.225827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:07.227662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:07.230490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:07.400872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:07.414660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a5997527-7889-4f5f-b961-b16e15f5274c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1245 microversion: 2.1 time: 0.237553 Sep 28 12:15:07.418280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 14/24] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:07 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1245 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:07.430910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:07.432112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:07.445559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:07.447069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:07.447859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:07.448797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:07.449396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:07.449984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:07.662695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:07.680850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-63ccaee1-891d-455b-851c-9e4ad15a8f3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1282 microversion: 2.1 time: 0.260935 Sep 28 12:15:07.703012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 15/25] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:07 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:07.876516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:07.911176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25193db2-61a0-453a-8d34-83be85c56232 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 1.156319 Sep 28 12:15:07.919319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 11/26] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:06 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:08.207763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:08.208553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:08.211787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:08.228121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.229660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.230277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:08.233766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.235548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.237298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:08.271489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795393034", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0a9dafc-fc91-423a-8269-e35c8e5ecc91"}], "security_groups": [{"name": "tempest-securitygroup--984571633"}], "key_name": "tempest-keypair-266835590", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:08.542702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:08.558327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ef9ef76a-aa2c-4d2b-a7a6-688939a6fe9a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1288 microversion: 2.1 time: 0.355266 Sep 28 12:15:08.568580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:08 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1288 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:08.575836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:08.579150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:08.588515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.591432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.591432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:08.591432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.591432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.591770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:08.874002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:08.890690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-712c574b-b900-46bc-a267-937b89f06091 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1237 microversion: 2.1 time: 0.326938 Sep 28 12:15:08.893586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:08 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1237 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:08.903114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:08.904263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:08.931396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.932696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.940079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:08.941246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:08.944972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:08.945736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:09.163381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:09.180938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b79fa424-9170-4dc1-adb2-0d490e708809 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1280 microversion: 2.1 time: 0.280005 Sep 28 12:15:09.182425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 18/29] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:08 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:09.193569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:09.206239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:09.224784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:09.225450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:09.235224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:09.238507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:09.239257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:09.240786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:09.578209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:09.589830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4cfbd477-5c0d-4103-8b5a-0866c700fa16 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 0.403883 Sep 28 12:15:09.614715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 19/30] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:09 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:09.631327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:09.633525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:09.652038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:09.653036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:09.654366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:09.656159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:09.659943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:09.660747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:09.796899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] validate_networks() for [('f0a9dafc-fc91-423a-8269-e35c8e5ecc91', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:15:10.213687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:10.230382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-de995be6-e2ed-4760-9a5f-88a0be2d46fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.611935 Sep 28 12:15:10.235495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 20/31] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:09 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:10.253536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:10.254429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:10.265030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.265909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.266506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.268822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.269474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.271898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.380215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:10.390235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-aa152a26-ed55-477e-bb44-c0b85f9c79b8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.153144 Sep 28 12:15:10.393914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 21/32] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:10 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:10.413531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:10.413531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:10.426630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.427128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.427571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.428290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.428765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.429193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.798554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:10.807844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a6d4df7-02fd-4124-8c9f-11bc58234bb9 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.409507 Sep 28 12:15:10.829230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 22/33] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:10 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:10.837635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:10.841646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:10.851335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.851843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.852286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.853112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:10.853565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:10.853994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:10.893319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:10.950081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:10.958551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-17d83a2f-c83c-4fee-825a-c18b27c5f738 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1272 microversion: 2.1 time: 0.128077 Sep 28 12:15:10.959337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 23/34] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:10 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:11.260421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:11.261784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:11.287883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.288585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.289109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:11.289936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.290461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.290960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:11.463969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:11.481626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-02c60726-a1ed-468f-bd87-5716adab29a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.225348 Sep 28 12:15:11.493770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 24/35] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:11 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:11.512914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:11.518664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:11.541025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.541833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.543123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:11.546345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.548573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.550558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:11.704520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:11.714154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-546e2770-ddd6-4633-aa7b-d417c25148f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.211268 Sep 28 12:15:11.715704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 25/36] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:11 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:11.967567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:15:11.968075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:15:11.971108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:15:11.975743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:15:11.976445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:15:11.992901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.993570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.994142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:11.995100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:11.995692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:11.996273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.046767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for project ba288a6bdc4e41729bd679733eaee61e. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:15:12.061183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for user 820f4bb963644499a77fa1f3edd59d08 and project ba288a6bdc4e41729bd679733eaee61e. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:15:12.098061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:15:12.100054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb09cfc-7e3e-4928-ab77-6b692cbad71d", "tag": "c95b849d-4e22-4734-acc8-e20b2732e38c"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:12.101427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:15:12.127207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.127596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.128017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.165451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Creating event network-changed:c95b849d-4e22-4734-acc8-e20b2732e38c for instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d on hv-cinder-85919 Sep 28 12:15:12.166336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120636) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 12:15:12.166775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b5b92bd2-2675-4263-80a7-4914fd6d72fd req-eea25c55-49b9-4c48-aef1-2254cf45b556 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120636) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 12:15:12.168041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.168814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.169300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.170606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.171202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.171616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.179366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f82efb54-59c9-47d3-a9ed-f0da39773996 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.912405 Sep 28 12:15:12.181429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 12/37] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Sep 28 12:15:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 3915 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 28 12:15:12.183218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.compute.rpcapi [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 12:15:12.184131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] Releasing lock "compute-rpcapi-router" {{(pid=120636) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 12:15:12.187469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:12.188690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:12.196498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.197344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.198090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.202071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8f0caf1d-a637-4501-902a-893efdef0303 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483990 Sep 28 12:15:12.202932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 26/38] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:12.206572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.207088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.207596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.210708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:12.211830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:12.222517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.223130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.223650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.224771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.225127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.226078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.465290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.474519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0805f84c-311c-4cbf-9391-94873f4cc165 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.291812 Sep 28 12:15:12.475103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 13/39] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:12 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:12.493063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:12.493938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:12.581283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.610379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.620818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.625714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ad51e4c0-5718-487d-b0c3-c7747c0e1a6d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1281 microversion: 2.20 time: 0.147363 Sep 28 12:15:12.626634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 14/40] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:12 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:12.633151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:12.634549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:12.644257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.645190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.646100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.647150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.648002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.648909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.792677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.799063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.806816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f79c5f13-1ae1-4b59-963e-223b1fc2e754 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.600933 Sep 28 12:15:12.807635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 27/41] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:12 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:12.815650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:12.816714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:12.834764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.835335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.838878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.839684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:12.840147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:12.841096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2da94d5e-2f7d-4d3e-b7c7-eae8c83281c7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.212319 Sep 28 12:15:12.843005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:12.850381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 15/42] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:12 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:12.967863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:12.977598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c1842bea-b9f3-4582-9f8d-c89c2f806d86 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.168632 Sep 28 12:15:12.978172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 28/43] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:12 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:13.499911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:13.500362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:13.506459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.507136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.507576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.508273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.509012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.509467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.648261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:13.655496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:13.656594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:13.658283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df184484-4523-44d7-bcf6-26c4a62e53dd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.162982 Sep 28 12:15:13.666144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.666911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.667585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.668559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.669214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.670692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.674400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 16/44] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:13 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:13.741461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:13.750279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:13.751810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:13.753174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a81d4ed6-b953-47b0-b588-519de9d9e8df tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1285 microversion: 2.20 time: 0.103282 Sep 28 12:15:13.753877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 29/45] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:13 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:13.829852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:13.830749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:13.833895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:13.838237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.839399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.840053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.840859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.841540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.842217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.898383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:13.899012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:13.906429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.907193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.907939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.908891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:13.909543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:13.910130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:13.995707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.006442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1a6164b-ea3b-42a0-982f-5ad916bd484c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.180390 Sep 28 12:15:14.007026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 17/46] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:13 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:14.011950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:14.012598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:14.019020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.023010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.027415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.028227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.029812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.031176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.031824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.032543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9bbf1d8a-d5ba-46f7-8029-a460780304cc tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.138725 Sep 28 12:15:14.048689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 30/47] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:13 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:14.118494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.127377 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59e89aee-da15-4372-bbf6-378fa4afc484 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.119209 Sep 28 12:15:14.128421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 18/48] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:14 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:14.682854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:14.683562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:14.690434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.692844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.697304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.698216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.698815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.699323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.778639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:14.780557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:14.787829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.788338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.788788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.789494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:14.789950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:14.790373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:14.860455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.869595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c029552d-a78c-49e4-be65-abf04e024184 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.190243 Sep 28 12:15:14.870582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 31/49] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:14 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:14.883922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.902103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.903969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:14.912482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-756e430c-34fb-400b-9e89-27661cf69503 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1285 microversion: 2.20 time: 0.133842 Sep 28 12:15:14.913959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 19/50] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:14 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:15.028729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:15.029884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:15.035939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.036571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.037013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.037986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.038450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.038879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.054902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:15.062711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:15.072566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.073283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.073932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.074942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.075604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.076217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.178918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:15.200165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79a9d64a-6786-4397-85f3-48040d162698 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.144096 Sep 28 12:15:15.211620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 20/51] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:15 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:15.212215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:15.212927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:15.245286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.245807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.246345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.247616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.247616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.248046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.363506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:15.372902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31e42a28-6966-419c-843a-200cf277ed61 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.166243 Sep 28 12:15:15.385972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 21/52] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:15 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:15.436053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:15.445610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2235965d-ee28-4d4b-845c-537f476e1ba5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.420598 Sep 28 12:15:15.446272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 32/53] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:15 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:15.897303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:15.901359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:15.910580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.911362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.912129 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.913062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.913691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.914417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.941532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:15.942139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:15.945370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:15.979545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.983086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.983535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:15.984279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:15.985377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:15.985819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.124153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.143898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20941bf2-9063-4432-a9b9-a43047274e99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.255079 Sep 28 12:15:16.160870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 22/54] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:15 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:16.182724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.193749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.195747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.197961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a7e12e98-116b-4a54-8f3d-b0fd2dfa9a84 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1285 microversion: 2.20 time: 0.259908 Sep 28 12:15:16.209351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 33/55] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:15 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:16.230761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:16.231573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:16.244789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.248051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.249833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.252487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.252971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.253402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.401939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:16.402652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:16.416048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.426841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-45e45021-96c8-4347-bebd-f0776deafd90 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.199992 Sep 28 12:15:16.434364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.436837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 23/56] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:16 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:16.437257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.438007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.438904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.441703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.442299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.473022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:16.473965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:16.493690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.500899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.501514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.508756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:16.509497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:16.513954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:16.836533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:16.869080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fe8e46d2-d498-47a2-ace4-027aa1b7c46d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1293 microversion: 2.1 time: 0.474539 Sep 28 12:15:16.869962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 34/57] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:16 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1293 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:17.177424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:17.178066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:17.191744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.192453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.207372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:17.208334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.208847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.209334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:17.714678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:17.725229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddd231f4-afe4-4e62-84eb-543baab3eeda tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 1.257120 Sep 28 12:15:17.727523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 24/58] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:16 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:17.743202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:17.743917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:17.763117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.763908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.764548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:17.765626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.766237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.767686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:17.814506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:17.910677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:17.922335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f139edad-818e-4da3-806b-e8a010561c58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.753611 Sep 28 12:15:17.941131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 35/59] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:17 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:17.952708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:17.954950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:17.967200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.971953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.972547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:17.973436 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:17.974034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:17.974587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.082667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:18.104337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dd2fdb12-45f9-4fc7-8273-eff80551f921 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.161689 Sep 28 12:15:18.109314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 36/60] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:17 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:18.114580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:18.127427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:18.129333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:18.144107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.144358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:18.148473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.149067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.150232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.151610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.152602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:18.152745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.158995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c86fcd8-942a-4ef6-a4a9-971edb0dbe3a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.426824 Sep 28 12:15:18.159621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 25/61] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:17 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:18.421408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:18.439019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-29d2ffc6-a936-49e3-8c04-04f57c8fda15 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1311 microversion: 2.1 time: 0.328465 Sep 28 12:15:18.439619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 37/62] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:18 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:18.756841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:18.758870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:18.775328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.776152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.776920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.777799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.778452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.782946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.927687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea91ff5b-8157-441e-a031-545af552cb3e", "tag": "7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:18.942029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.942447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.942885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.962311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] Creating event network-changed:7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8 for instance ea91ff5b-8157-441e-a031-545af552cb3e on hv-cinder-85919 Sep 28 12:15:18.970747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-05f27279-ba7f-4c66-86aa-f0f18cbe45f0 req-eb05a72e-e79e-4288-9545-020d630e0a61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051187 Sep 28 12:15:18.972229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 38/63] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:18.980391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:18.983088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:18.990632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.991128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.991570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:18.992443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:18.993041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:18.994184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.086604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.104484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1fdb21dd-9e7b-469d-ae39-5f6bbf0bb539 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.352658 Sep 28 12:15:19.106163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 26/64] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:18 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:19.131088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:19.131831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:19.139241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.139800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.140440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.141428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.141975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.142492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.176643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.184259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bc26813a-40eb-46ef-9109-997b9fa3e370 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.210673 Sep 28 12:15:19.196807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 39/65] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:18 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:19.224104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.236951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43354634-14fa-489f-894c-fb8af64fbd4d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.109696 Sep 28 12:15:19.238064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 27/66] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:19 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:19.242739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:19.243660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:19.250959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.251705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.252247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.253427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.253957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.254621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.267771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731779ea-c029-470d-af83-4091842d12f7", "tag": "e5002f8f-acaa-44e8-88ec-5dce7805e265"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:19.279237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.279795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.280236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.295974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] Creating event network-changed:e5002f8f-acaa-44e8-88ec-5dce7805e265 for instance 731779ea-c029-470d-af83-4091842d12f7 on hv-cinder-85919 Sep 28 12:15:19.301473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-697c8329-b772-4945-8022-3b58c1e86096 req-333a2449-70ce-4664-b196-bfa69c2a003b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114088 Sep 28 12:15:19.302479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 40/67] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:19.328023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.336169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.337613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.338782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-318e8efc-0723-4ab9-8912-a542ea223725 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.099499 Sep 28 12:15:19.339275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 28/68] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:19 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:19.468142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:19.469121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:19.475226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.475708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.476163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.476861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:19.477325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:19.477739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:19.546271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:19.549912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:19.557203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-96dfb975-cafa-40b2-8841-dd78ef1a72d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1311 microversion: 2.1 time: 0.093679 Sep 28 12:15:19.565065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 41/69] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:19 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:20.129562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:20.130804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:20.138232 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.138966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.139553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.140494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.141313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.142777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.210474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:20.211815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:20.222028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.222751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.223430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.224496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.225266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.225951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.289500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.298673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acfe3218-c854-4ab0-b1ae-d0494520f313 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.173165 Sep 28 12:15:20.299413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 29/70] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:20 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:20.319851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:20.320994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:20.327733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.328468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.329078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.329953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.330560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.331140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.430833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.447678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.454182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b460e0b-ff31-42c6-bcf7-96930df0bd5d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.140660 Sep 28 12:15:20.454987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 30/71] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:20 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:20.455432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cc04dd8f-b237-4f7c-a311-68c21d17c746 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.249449 Sep 28 12:15:20.460455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:20.461289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:20.468945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.469743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.470511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.471019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 42/72] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:20 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:20.471501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.471820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.472247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.547781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.560112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.562546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.563676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2610790-090a-4163-86a0-97505b1473a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.107385 Sep 28 12:15:20.564990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 31/73] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:20 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:20.580813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:20.581655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:20.587990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.588628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.589159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.590080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:20.591056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:20.591734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:20.687683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:20.695677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-002da0fa-204e-4378-9b1e-47168f3f63a6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1311 microversion: 2.1 time: 0.119258 Sep 28 12:15:20.696933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 43/74] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:20 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:21.327483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:21.328095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:21.334476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.334962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.335434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.336166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.336647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.337269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.478793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:21.479422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:21.483460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.489529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.490041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.490476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.492419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.493072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.493684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.498568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19e13222-ba59-45ef-a2e2-6d64e5db8520 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.175737 Sep 28 12:15:21.500699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 32/75] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:21 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:21.516365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:21.517238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:21.525431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.525711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.526142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.526939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.527391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.527811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.567400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.576055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-97f86e62-714f-4b74-a7be-7225381d8457 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.102138 Sep 28 12:15:21.576685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 44/76] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:21 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:21.602315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:21.602315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:21.609763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.610248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.610728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.611486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.611938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.612435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.667926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.677499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-75ae065c-a57b-47c5-b012-eabb85529ee8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.175592 Sep 28 12:15:21.678088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 33/77] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:21 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:21.680741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.689562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.691037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.692141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c466f3da-87d7-45b5-a696-c022a8176046 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.094554 Sep 28 12:15:21.692869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 45/78] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:21 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:21.725902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:21.726712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:21.733947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.734509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.735020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.735799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:21.736357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:21.736841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:21.805427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:21.815534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96ce1e84-10d4-4d86-bb23-24d204de778d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1311 microversion: 2.1 time: 0.094155 Sep 28 12:15:21.816225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 34/79] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:21 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:22.520647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:22.521857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:22.524018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=8 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:22.530278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.536488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.536488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.536488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.536488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.536866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.600229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:22.600229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:22.602203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:22.608675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.609609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.610085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.611321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.612079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.612547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.612975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=32 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:22.674469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.676596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.683224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0dd6b206-4d0d-488c-9725-7b287800bef6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.166557 Sep 28 12:15:22.684814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3c53cd6b-2749-41c6-833d-256dd90bb4bb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.089698 Sep 28 12:15:22.685384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 35/80] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:22 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:22.695965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 46/81] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:22 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:22.702650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:22.703366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:22.709489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.710107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.710616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.712264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.712264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.712264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.718510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:22.719532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:22.726778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.727383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.727850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.728929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.729375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.730017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.808795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.818524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.819619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.820765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-988aeba9-7bb6-405d-9013-aee469d3efe2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.107246 Sep 28 12:15:22.821319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 47/82] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:22 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:22.839180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:22.840763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:22.847114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.847704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.848433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.849136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:22.849683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:22.850091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:22.858150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.867200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11bd6eff-ccbb-4ac4-a642-7fa04fb649e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.169635 Sep 28 12:15:22.867929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 36/83] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:22 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:22.924250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:22.934121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7f13dd24-8d41-45ff-98db-90e4f6e7fb47 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1311 microversion: 2.1 time: 0.098798 Sep 28 12:15:22.935017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 48/84] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:22 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:23.707502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.708199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:23.713138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.713742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:23.725784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.727519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.728003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.728458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.729157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.729602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.730017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.730724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.731033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.731722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.732379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.732800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.807830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:23.816496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2c491172-a248-4dc5-a84b-e26188899ebd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.112793 Sep 28 12:15:23.817396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 49/85] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:23.845632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.846600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:23.852647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.853345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.853789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.854785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.855157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.855683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.876791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:23.886854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d043c309-46cb-462a-ba8a-cc1ee8a69c34 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.177617 Sep 28 12:15:23.887586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 37/86] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:23.904403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.905050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:23.913802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.914294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.914724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.915428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.915878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.916300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.940123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:23.948463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:23.950146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:23.952143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d25f7f7a-71aa-4dc8-ae37-49d35baf07a7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.110792 Sep 28 12:15:23.952881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 50/87] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:23.958214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:23.958821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:23.964992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.965690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.966382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:23.967291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:23.967931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:23.968581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.078088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:24.087950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b16e38a7-6428-4c07-8d47-fcab293bc96c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.198779 Sep 28 12:15:24.089521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 38/88] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:24.169792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:24.177502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-30dc6ca2-1fcb-4afa-a4c6-4435f49333f6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1299 microversion: 2.1 time: 0.222830 Sep 28 12:15:24.178060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 51/89] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:23 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:24.840974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:24.842907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:24.854853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.856802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.858504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.859390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.863636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.864055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.911444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:24.912096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:24.926136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.927763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.928536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.929989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.931473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.931974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.937863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:24.950062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e7f4650-4acd-4161-97f4-c2df26e3e17d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1294 microversion: 2.1 time: 0.113512 Sep 28 12:15:24.958065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 39/90] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:24 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:24.978348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:24.979265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:24.988768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.992539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.994779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:24.997023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:24.998595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:24.999099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.076599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.088961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.095985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.097183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d815a8ee-7e41-4ed9-9a25-4159664e9ff3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.122653 Sep 28 12:15:25.098214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 40/91] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:24 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:25.119056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:25.120752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:25.131319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.132062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.133623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.134520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.135135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.135717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.292225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.302814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-aaf5df8a-492a-40c7-b300-9d1204a42bd9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.396194 Sep 28 12:15:25.303028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.303850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 52/92] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:24 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:25.309026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:25.310007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:25.317186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.317923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.318552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.318999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96f4736e-6a1e-47a6-86ec-0d7f442395d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.204761 Sep 28 12:15:25.320885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 41/93] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:25 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:25.321108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.322235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.322759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.425121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:25.437956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-20ff5f7c-20d5-4ee2-9529-e6b2d55dc97c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1299 microversion: 2.1 time: 0.132656 Sep 28 12:15:25.438534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 53/94] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:25 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:25.978427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:25.978796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:25.985735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.986224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.986662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.987618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:25.988075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:25.988599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:25.992954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:26.119729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.124919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:26.125521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:26.128438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-693f115d-75e2-4566-81c6-b4da621ef492 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.154722 Sep 28 12:15:26.132345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 42/95] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:25 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:26.132481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.132481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.132481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.133013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.133458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.134023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.197418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.208681 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.210187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.211318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c953b095-2c7b-495e-9ba2-7ca051a4f7d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.091239 Sep 28 12:15:26.211873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 54/96] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:26 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:26.327075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:26.327700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:26.333858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.334338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.334771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.335460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.335912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.337828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.344968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:26.346174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:26.352183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.353004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.353643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.354553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.355156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.355642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.484022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.501204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28e56b58-db4f-4d18-8088-1dfb54217314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.177929 Sep 28 12:15:26.502391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 43/97] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:26 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:26.518164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:26.519180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:26.528684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.530006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.530634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.531541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:26.532169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:26.533272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:26.537328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.552068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-63a6a689-e0d3-48a5-b223-60a9738d3b9c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.212880 Sep 28 12:15:26.552711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 55/98] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:26 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:26.698328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:26.706942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cfaf30f-d8fb-466b-8f85-bc2853f3033e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.202702 Sep 28 12:15:26.707513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 44/99] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:26 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:27.153125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.153737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:27.159611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.160084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.160543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.161218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.161665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.162085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.237576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.238302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:27.244291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.244981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.245410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.246096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.246539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.246980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.309336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.317496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.318925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.320017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d778929-898c-4252-8186-7ad50201254c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.086357 Sep 28 12:15:27.320699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 45/100] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:27.350149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.363039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1be530f1-edd5-48ab-b28a-384ae7f94513 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.213508 Sep 28 12:15:27.363679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 56/101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:27.524862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.525580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:27.532000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.533365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.534365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.535925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.536818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.537247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.574627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.575227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:27.581309 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.581848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.582291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.582976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.583850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.584275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.678008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.685891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91137afa-7ae0-48b0-aabd-1e3a4bc3fa2b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.164669 Sep 28 12:15:27.688346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 46/102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:27.733268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:27.733904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:27.739922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.740429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.740857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.741544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:27.741991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:27.742405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:27.742904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.750951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ad8d3bed-9d2e-4539-9352-3c279d419df1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.180060 Sep 28 12:15:27.751736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 57/103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:27.878306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:27.886074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c86d5617-c02c-400a-b925-44dd9e806910 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.157169 Sep 28 12:15:27.896334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 47/104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:27 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:28.347102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:28.347895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:28.354143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.354839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.355329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:28.356015 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.356499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.356919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:28.377938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:28.395391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:28.396732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:28.403999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.404841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.405375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:28.406314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.406939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.407491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:28.429109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:28.438751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:28.440183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:28.441314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-998205f7-04bc-416c-bd53-efe8b23a8b7f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1333 microversion: 2.20 time: 0.098460 Sep 28 12:15:28.442201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 58/105] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:28 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:28.707880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:28.708515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:28.721749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.722242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.722678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:28.723384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:28.723830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:28.724626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.032801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.047811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1eb2c8ad-df5f-4e03-ab33-6cda86c5442b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.664357 Sep 28 12:15:29.049273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 48/106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:28 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:29.073150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:29.074358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:29.087005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.087796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.088345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.089238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.090038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.090532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.272630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.285971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-68b826d8-418c-479f-9ea6-2f178cab0335 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.580534 Sep 28 12:15:29.296175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 59/107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:28 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:29.300848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:29.301449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:29.308948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.309426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.309861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.310582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.311024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.312204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.454769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.465798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0eaf51dc-3aaa-4215-86c0-dd60c8af68d7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.414324 Sep 28 12:15:29.469385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 49/108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:29 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:29.491659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:29.492851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:29.504186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.504899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.505565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.506353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:29.507138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:29.507562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:29.644646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.655599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.662811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.664255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-497b4dd2-106c-4128-a56a-5e33af9216b5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1339 microversion: 2.20 time: 0.193529 Sep 28 12:15:29.668113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 50/109] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:29 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:29.699705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:29.707954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b2ce770f-92dd-4edc-8dc9-9a28c19bfca5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.410660 Sep 28 12:15:29.712739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 60/110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:29 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:30.071260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.072190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:30.079099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.079761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.080190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.080907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.081509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.081936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.285614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.295752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-871c07d6-4034-416a-a4fb-df144b03a35e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.228605 Sep 28 12:15:30.302170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 51/111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:30.319095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.319635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:30.326597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.327081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.327507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.328572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.329027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.329445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.391395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9", "tag": "cc0af34f-a04e-4ebc-b617-e2310dc4c9c6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:30.407180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.408027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.408490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.430571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Creating event network-changed:cc0af34f-a04e-4ebc-b617-e2310dc4c9c6 for instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 on hv-cinder-85919 Sep 28 12:15:30.431091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 12:15:30.431476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-33366c29-324a-418b-9588-302f571d3977 req-17f206dd-9279-46a4-8c46-2b6a32e0eb15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 12:15:30.432756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.433223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.433645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.434356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.434820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.435819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.445489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.compute.rpcapi [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 12:15:30.446732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] Releasing lock "compute-rpcapi-router" {{(pid=120637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 12:15:30.464447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1a9a9141-f9a3-49b8-a6d7-5493220a5729 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078095 Sep 28 12:15:30.465182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 52/112] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:15:30.492919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.493718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:30.500968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.501628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.502067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.502763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.503226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.503653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.556378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.566657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9a86ffcb-2dfc-452c-bc1e-c1d8714989fd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.251880 Sep 28 12:15:30.567294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 61/113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:30.661400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.669163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed1b00a3-5469-4f7d-abb1-118d5b6ee4bf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.181610 Sep 28 12:15:30.670410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 53/114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:30.693567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.694180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:30.701135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.702455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.702898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.703751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.704455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.704919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.733564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:30.734172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:30.740258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.740765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.741433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.742343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:30.743001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:30.743644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:30.868656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.882937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.885276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.886780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-574d0cf4-8a2c-4b1a-8031-b3af862e64e3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.196749 Sep 28 12:15:30.898845 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 62/115] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:30.918671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:30.921969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-54396ee7-e48f-4c95-88f5-a79cba097b12 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.192717 Sep 28 12:15:30.922543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 54/116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:30 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:31.324330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:31.324947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:31.331325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.331799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.332224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.332943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.333388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.333807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.511632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:31.520149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a6b58c0c-b20f-4e28-bb4b-961656885d34 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.199726 Sep 28 12:15:31.520755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 63/117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:31 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:31.592187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:31.593257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:31.602107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.602769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.603256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.604084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.604726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.605664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.692553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:31.693177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:31.699011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.699494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.699928 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.700692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.701144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.701643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.780127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:31.789645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9342cd0b-60c4-4be0-81fd-4738b91a8f6b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.201455 Sep 28 12:15:31.790278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 55/118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:31 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:31.848696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:31.856422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8bdd395-88eb-44ec-9bdc-2c79a6891615 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.168040 Sep 28 12:15:31.857539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 64/119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:31 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:31.914711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:31.915308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:31.921320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.921794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.922226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.922903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.923345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.923766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.944689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:31.945441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:31.951810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.952515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.952946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:31.953911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:31.954368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:31.954792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.072970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.082733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.084434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.085743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-900dcb99-3e16-4cde-be18-7abe9c17972b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.174938 Sep 28 12:15:32.086504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 56/120] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:31 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:32.095129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.105551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cceb5ed1-4bb3-44c4-9e3a-77be73ec8aa6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.164776 Sep 28 12:15:32.106129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 65/121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:31 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:32.486211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dafad59-8746-4b43-9873-444b28b0da27", "tag": "5d5dc8e7-99bd-40f3-8aca-1ca4833608cf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:32.493735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.494190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.494881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.508225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] Creating event network-changed:5d5dc8e7-99bd-40f3-8aca-1ca4833608cf for instance 7dafad59-8746-4b43-9873-444b28b0da27 on hv-cinder-85919 Sep 28 12:15:32.515635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-795011c0-8ee2-444a-9448-f55e2be7e882 req-bda079f5-8de2-4ae7-9eac-be3f8338953a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038513 Sep 28 12:15:32.516947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 57/122] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:32.542869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:32.543571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:32.546567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:32.554856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.555338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.555771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.556486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.556933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.557349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.722119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.729866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-06d9797f-177c-4f2c-b6e6-62709a4201ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.191192 Sep 28 12:15:32.730428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 66/123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:32 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:32.813406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:32.814096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:32.820428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.820914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.821347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.822063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.822516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.822939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.881454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:32.882335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:32.888590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.889158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.889807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.890590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:32.891136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:32.891472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:32.970711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:32.980018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6eee1906-bfc7-47ca-a540-2c8a2fdd7a37 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.170387 Sep 28 12:15:32.980683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 58/124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:32 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:33.041062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.049147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-13cd06ac-7a77-49db-8c71-c9a3855f8402 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.172909 Sep 28 12:15:33.049766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 67/125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:32 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:33.113001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:33.113742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:33.119445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.120048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.120520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.121319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.121767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.122186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.128756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:33.129442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:33.135480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.136039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.136571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.137328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.137870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.138389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.273958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.277547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:33.285833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.287379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.288691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e50fa47d-ae5f-4bab-a94e-dd8f6573b1f7 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.179477 Sep 28 12:15:33.292569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.296693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 59/126] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:33 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:33.304702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5813f68f-1450-4031-ad17-355ed441c459 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.179657 Sep 28 12:15:33.305285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 68/127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:33 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:33.753305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:33.754154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:33.760373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.761047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.761478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.762159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:33.762608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:33.763024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:33.899000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:33.907303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e70634ac-742b-4423-925c-409cec386e7b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.157892 Sep 28 12:15:33.907892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 60/128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:33 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:34.002586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.003195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:34.010058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.010504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.011208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.012590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.013638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.014129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.073538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.074140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:34.080594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.081079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.081509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.082203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.082653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.083269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.189308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.199651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1012a12d-cd98-4570-9d11-575bd7adde27 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.200572 Sep 28 12:15:34.200604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 69/129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:33 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:34.231340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.240101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f01ce0d8-dc50-418a-b30c-793016f4a2e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.170474 Sep 28 12:15:34.240791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 61/130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:34 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:34.313835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.314443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:34.320451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.320941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.321423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.322301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.322749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.323166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.326810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.327450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:34.335019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.335699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.336523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.338072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.339645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.339645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.481462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.492103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.493699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.494921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a2b61c86-61cb-40c1-aec5-8bb0bb6468d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.184940 Sep 28 12:15:34.500584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 70/131] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:34 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:34.514099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:34.524390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-897d0f67-0ca1-495a-bd14-0aa1dadd11aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.198772 Sep 28 12:15:34.524390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 62/132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:34 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:34.930190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:34.930797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:34.939033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.939517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.939945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:34.940665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:34.941119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:34.941545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.076527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.085222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f19ed67d-d4fd-4e96-8b77-be032d7818ba tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.158867 Sep 28 12:15:35.085941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 71/133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:34 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:35.231492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:35.232884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:35.238839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.239315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.239745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.240468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.240921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.241341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.263446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:35.264139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:35.270044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.270600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.271108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.271906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.272462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.272960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.368107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.375843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d557bac3-ed08-4c2f-ae47-e54f2beb9d78 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.148587 Sep 28 12:15:35.376429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 63/134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:35 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:35.402938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.411458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-300c4d6f-36d2-4711-930d-3a0cdcf00621 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.152170 Sep 28 12:15:35.412006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 72/135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:35 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:35.521319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:35.521986 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:35.528112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.529233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.529768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.530656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.531103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.531521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.544970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:35.545602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:35.551509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.551981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.552438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.553117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:35.553569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:35.553989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:35.674463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.684707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.686415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.687838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf55f636-0cf7-4a7c-adf7-0183c29294c4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.171039 Sep 28 12:15:35.688564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 64/136] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:35 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:35.713891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:35.722746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-da166255-554d-41f8-abb8-774466bdd0df tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.181523 Sep 28 12:15:35.731943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 73/137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:35 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:36.109486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:36.110093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:36.118515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.119188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.120604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:36.122057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.123042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.123759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:36.400385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:36.401872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:36.409412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.410084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.410679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:36.411745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.424227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.425396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:36.436153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:36.460569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-164bf1ab-0a88-492f-8461-1ed776510767 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.342687 Sep 28 12:15:36.461947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 65/138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:36 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:36.471513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:36.472399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:36.479382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.499665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.500535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:36.503063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:36.504362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:36.505275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.061960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.070218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9c1dda91-62f4-4cd4-bafb-2538d1ec357d tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.675349 Sep 28 12:15:37.071059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 74/139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:36 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:37.088488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:37.089254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:37.113791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.113791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.116659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.118218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.119083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.120083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.126065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:37.190191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.199742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9b2914d-a048-4bcd-b1ee-b539f018d63e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.736487 Sep 28 12:15:37.201045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 66/140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:36 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:37.206291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:37.207355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:37.211273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:37.220913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.221932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.222715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.223768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.224335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.224838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.485236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.506123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd677368-f9b0-4cf5-b8a6-522a809374ad tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.303785 Sep 28 12:15:37.506950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 67/141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:37 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:37.511934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:37.513097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:37.520211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.520727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.521282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.521980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.522641 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.523395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.625319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.633739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.635438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.636707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0d89db5d-a7a4-474e-8f83-9a11510c42d2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.558173 Sep 28 12:15:37.637260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 75/142] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:37 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:37.726893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:37.736026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2a205522-95dd-4dc4-8a73-1f970f9e89d4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.227780 Sep 28 12:15:37.744182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 68/143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:37 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:37.773844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300ee327-113a-408e-8cee-099a7cc2a0ee", "tag": "6d023a29-0ce0-422c-af0f-9f34e992320e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:37.785484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:37.786563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:37.787065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:37.801016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] Creating event network-changed:6d023a29-0ce0-422c-af0f-9f34e992320e for instance 300ee327-113a-408e-8cee-099a7cc2a0ee on hv-cinder-85919 Sep 28 12:15:37.806561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-920d7f1f-5fc2-421f-b831-258af0c1cfae req-818bbc66-bcd6-43f0-9d21-7d143cc0687c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036803 Sep 28 12:15:37.807537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 76/144] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:15:38.094658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:38.095676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:38.103097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.103662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.104167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.104976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.105602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.106161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.223898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:38.224985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:38.231359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.232113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.232752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.233478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.233913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.234369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.250915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.258611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e9f7b00-2119-4fe0-a3ed-76be566a13c8 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.168886 Sep 28 12:15:38.259180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 69/145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:38 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:38.389157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.397958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1a927bde-bb1a-4ef2-b231-4a18d68ca7b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.178282 Sep 28 12:15:38.398957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 77/146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:38 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:38.534965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:38.535577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:38.542235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.542704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.543863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.544634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.545080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.545531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.665637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:38.667226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:38.686017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.686536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.687204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.688072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.688564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.688997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.708446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.717559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-329cd5cd-aa64-4898-9bc8-d76b06974b2f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.187072 Sep 28 12:15:38.718326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 70/147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:38 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:38.758871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:38.759514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:38.766784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.767470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.768058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.769222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.769806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.770371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:38.871416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.880824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.882469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.883739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f1912eb5-b183-4143-8552-e313466eee7c tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.224771 Sep 28 12:15:38.896678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 78/148] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:38 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:38.925406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:38.934198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2581efab-5410-4dcc-ba4b-02b622507727 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.179079 Sep 28 12:15:38.935319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 71/149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:38 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:38.977779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb09cfc-7e3e-4928-ab77-6b692cbad71d", "name": "network-vif-plugged", "status": "completed", "tag": "c95b849d-4e22-4734-acc8-e20b2732e38c"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:38.987170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:38.987637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:38.988059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.001420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] Creating event network-vif-plugged:c95b849d-4e22-4734-acc8-e20b2732e38c for instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d on hv-cinder-85919 Sep 28 12:15:39.010815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-05845564-5647-4943-9ea0-5dfaca1110f1 req-2937a624-e89a-4d50-8558-438c658c8cfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112721 Sep 28 12:15:39.011438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 79/150] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:39.285938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:39.286555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:39.292750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.293235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.293667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.294883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.295337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.295766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.432540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:39.432540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:39.432540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.432540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.432969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.432969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.432969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.432969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.439284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:39.448589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b0bfff9a-2d17-4a88-9801-c34aff89e9de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.167547 Sep 28 12:15:39.449497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 72/151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:39 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:39.571544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:39.580532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8df8e320-e5bc-4c30-ac7c-4571c432dcbb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.161920 Sep 28 12:15:39.581108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 80/152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:39 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:39.742690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:39.743409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:39.751662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.757903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.758602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.759358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.759856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.760492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.913915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:39.914565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:39.932150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.935816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.936264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:39.937021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:39.937483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:39.937909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.114988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.123745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a933035-1c28-4778-8557-883c826d7e28 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.384832 Sep 28 12:15:40.124791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 73/153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:39 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:40.129368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:40.130088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:40.135969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.136711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.137342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.138758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.139271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.139877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.167874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.176255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.177688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.178881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0814c6c6-f21c-4033-b187-afbe57c21820 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.269205 Sep 28 12:15:40.181706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 81/154] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:39 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:40.268667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.276480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64cedc59-cebc-4af0-b833-f3e01f34615c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.150617 Sep 28 12:15:40.277040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 74/155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:40 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:40.474594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:40.475227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:40.482544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.483628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.484061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.485158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.485616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.486043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.605826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:40.606430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:40.608384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:40.614044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.614527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.614951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.615672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:40.616258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:40.616680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:40.657447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.666066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f2aef2e5-6ff9-4483-b992-c760b36c1dac tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.196295 Sep 28 12:15:40.666775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 82/156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:40 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:40.827871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:40.843454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65318ebf-fc88-4fb4-b77c-f2ffc862151e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.242063 Sep 28 12:15:40.844638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 75/157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:40 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:41.147654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:41.148886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:41.155459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.155945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.156410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.157253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.157875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.158302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.204332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:41.205394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:41.224573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.225407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.226600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.227531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.228334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.228942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.252099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:41.325185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.334014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ac61be67-2356-4fe1-a371-20b4ffe732c3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.190780 Sep 28 12:15:41.334594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:41 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:41.339846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:41.340674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:41.347915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.348613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.349196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.350203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.350822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.351284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.403382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.412198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.413666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.414772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07d59337-c3c2-4d31-92e7-b73034757065 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.215700 Sep 28 12:15:41.415329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 76/159] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:41 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:41.529358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.538170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-17c505f2-9369-475a-b57e-5010181dc38e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.202431 Sep 28 12:15:41.538827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 84/160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:41 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:41.689904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:41.690518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:41.696686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.697151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.697645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.698340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.698852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.699197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.864434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:41.866217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:41.866817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:41.872971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.873680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.874142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.875006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:41.875451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:41.875989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c04d23cb-5278-42e3-b918-af89cf21fb87 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.189759 Sep 28 12:15:41.876193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:41.888329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 77/161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:41 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:42.054239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.064159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-616af826-764c-4bc0-a00d-19fa0f29f166 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.201625 Sep 28 12:15:42.079675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 85/162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:41 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:42.361060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:42.361798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:42.370903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.382878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.383767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.384709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.385531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.386197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.445421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:42.448008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:42.467040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.467980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.468857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.471294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.472377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.475157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.750590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.762768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.765375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.766932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f1eb5880-cb7c-46d7-9b14-25e77e4196eb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.328322 Sep 28 12:15:42.767770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 86/163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:42 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:42.774194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:42.775100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:42.782538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.783129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.783685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.784791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.785707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.786598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.792091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.801132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d1d1917-4f7a-411e-865f-4cd11f35a94f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.445368 Sep 28 12:15:42.802237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 78/164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:42 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:42.899963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:42.900614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:42.911031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.911562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.911999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.912766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:42.913429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:42.913997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:42.958879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:42.971587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-851811be-391f-4e6a-a7d2-e0536adb1786 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.202504 Sep 28 12:15:42.972201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 87/165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:42 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:43.064642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:43.072083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d4a9eed0-4f69-4c74-8458-4aa5f9ed32ed tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.175933 Sep 28 12:15:43.072697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 79/166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:42 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:43.093310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:43.094441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:43.100665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.101151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.101582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.102600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.103063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.103487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.245761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:43.254294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e2159d1f-83b7-4ca3-bfb5-e168ba9bc04e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.168674 Sep 28 12:15:43.254893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 88/167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:43.794098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:43.794933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:43.805217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.805779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.806814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.807888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.808603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.809099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.826007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:43.826809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:43.833770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.834531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.835062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.836112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:43.836849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:43.837947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:43.973285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:43.990152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:43.991936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:43.993277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ae3b300-8198-4ae9-9c53-16367819dbb3 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.203666 Sep 28 12:15:43.994124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 80/168] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:44.000566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:44.001224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:44.008571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.009058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.009486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.010315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.011036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.011464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.040598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:44.060840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-373c153e-039d-4e57-8520-fac4e129bb62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.240141 Sep 28 12:15:44.064488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 89/169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:44.105753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:44.106489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:44.132009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.134478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.144186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.149261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.150883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.152115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.189118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:44.196916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86c747a5-70d9-4b4e-bb87-a80100e5c43d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.201750 Sep 28 12:15:44.197563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 81/170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:43 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:44.278317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:44.279200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:44.293068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.295441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.295895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.296829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.297441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.297860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.414153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:44.427708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a11daac5-0c4b-49d6-9fde-e561ec41adc5 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.330450 Sep 28 12:15:44.429182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 90/171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:44 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:44.535446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:44.547444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5aa95931-aaf3-4f82-9af4-4174ecf75a98 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.273104 Sep 28 12:15:44.556602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 82/172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:44 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:44.793737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731779ea-c029-470d-af83-4091842d12f7", "name": "network-vif-plugged", "status": "completed", "tag": "e5002f8f-acaa-44e8-88ec-5dce7805e265"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:44.806913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:44.807361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:44.807887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:44.821800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] Creating event network-vif-plugged:e5002f8f-acaa-44e8-88ec-5dce7805e265 for instance 731779ea-c029-470d-af83-4091842d12f7 on hv-cinder-85919 Sep 28 12:15:44.827426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-40dd5dde-89b2-40a4-9737-a759feead180 req-69dca6a1-dbbb-4869-8506-3193c4e60326 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037757 Sep 28 12:15:44.828051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 91/173] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:45.023296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:45.023969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:45.030034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.030588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.031011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.031693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.032315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.032744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.087669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:45.088383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:45.095582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.096477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.096908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.097579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.098024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.098608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.180903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.189967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.191615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.192757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b203fd92-f814-415d-9e6f-d3a8b92e6297 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.173788 Sep 28 12:15:45.193628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 83/174] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:45 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:45.229168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:45.230175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:45.236379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.236854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.237280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.237965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.238411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.238824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.251094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.259950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9e16cb72-4899-458c-a23f-e682df84282a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.176564 Sep 28 12:15:45.274931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:45 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:45.456462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:45.456462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:45.467518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.468009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.468479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.469434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.470786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.471212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.618352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.633373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a46bcb98-5c81-4339-bc98-8880bbd8e4a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.407967 Sep 28 12:15:45.638428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 84/176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:45 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:45.643074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:45.643796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:45.649905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.651018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.651803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.652727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:45.653397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:45.654067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:45.793531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.798905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:45.808663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ac34f9ec-cf1a-4f51-b354-39a50b9358dd tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.361087 Sep 28 12:15:45.811270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:45 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:45.878807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:45.888357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b1d6638c-ff4d-4726-8e54-cd2d957123ae tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.248282 Sep 28 12:15:45.889114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 85/178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:45 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:46.225272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:46.225922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:46.236216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.236738 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.237171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.237868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.238316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.239035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.284281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:46.285156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:46.291770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.292816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.292938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.293596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.294041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.294784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.418635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:46.433651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:46.436733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:46.438257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b1be1052-8c91-41f2-857a-76a8aab7f061 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.219004 Sep 28 12:15:46.444847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 94/179] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:46 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:46.532671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:46.541099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b07cef0c-53e3-4765-b711-cf5109ead6b3 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.261938 Sep 28 12:15:46.549304 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 86/180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:46 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:46.658056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:46.658948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:46.665685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.666369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.666810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.667497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.667949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.668397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.834723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:46.835326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:46.842176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.844688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.845501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.846365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.847290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.847764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.876022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:46.891787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6faa71f5-0f61-44e7-adad-92772c9691a1 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.238264 Sep 28 12:15:46.892774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:46 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:46.923170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea91ff5b-8157-441e-a031-545af552cb3e", "name": "network-vif-plugged", "status": "completed", "tag": "7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:46.945161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.945645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.946074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.968130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] Creating event network-vif-plugged:7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8 for instance ea91ff5b-8157-441e-a031-545af552cb3e on hv-cinder-85919 Sep 28 12:15:46.974213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-6c29c1ce-2950-4f2c-b876-119043d4bc20 req-2bfc4f6e-dc50-411b-9b92-e29b2cbaa293 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073426 Sep 28 12:15:46.977185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 96/182] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:46.986770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:46.987851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:46.994393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.994877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.995496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:46.996192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:46.996831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:46.998113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.029811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.041334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3eebd0fe-026b-41f8-985c-b36204a4c702 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.209959 Sep 28 12:15:47.042490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 87/183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:46 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:47.191203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.194310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-002d40b8-8d30-42f4-b0b5-d30102555b14 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.213899 Sep 28 12:15:47.194882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 97/184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:46 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:47.467626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:47.470851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:47.481592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.482577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.483239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.484096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.485110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.486067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.565254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:47.565864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:47.574882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.575925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.579248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.580037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.580537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.580972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.736926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.752670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.755665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.757855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28686d59-061a-4e2b-93d7-b35e318187ab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.296276 Sep 28 12:15:47.761359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 88/185] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:47 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:47.789500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:47.798298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-97f16b23-e6b7-4044-a263-ede362f6e3da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.236773 Sep 28 12:15:47.798900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 98/186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:47 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:47.919813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:47.920801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:47.929462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.930914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.931541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:47.933323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:47.933868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:47.935247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.067719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:48.068487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:48.077136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.078744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.079471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.082933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.085109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.088570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.310031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:48.320902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:48.321417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3578c08c-3ccb-440e-8128-0464b858f3e1 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.257889 Sep 28 12:15:48.322533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 99/187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:48 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:48.330719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:48.331709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:48.340161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.341562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.342158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.343056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.343950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.349783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac856484-9efd-41d6-94ba-f452e2282100 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.434234 Sep 28 12:15:48.349783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 89/188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:47 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:48.350462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.515893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:48.526043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eaaef91e-9112-47fd-9f4c-63e00c545e8f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.201971 Sep 28 12:15:48.526977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 100/189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:48 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:48.788058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:48.789296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:48.800036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.801580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.802205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.803346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.804292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.804879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.821598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:48.822967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:48.831497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.832293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.832965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:48.833818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:48.835140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:48.835578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.155430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.164969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.166730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.168134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c71c4a44-a233-41f8-9d77-3917e032f35e tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.385176 Sep 28 12:15:49.168951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 90/190] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:48 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:49.174555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dafad59-8746-4b43-9873-444b28b0da27", "name": "network-vif-plugged", "status": "completed", "tag": "5d5dc8e7-99bd-40f3-8aca-1ca4833608cf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:49.185793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.186674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.187569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.192094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.199756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-462029d9-345e-44d4-802f-0e16e5615dce tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.382570 Sep 28 12:15:49.200905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 101/191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:48 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:49.222026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] Creating event network-vif-plugged:5d5dc8e7-99bd-40f3-8aca-1ca4833608cf for instance 7dafad59-8746-4b43-9873-444b28b0da27 on hv-cinder-85919 Sep 28 12:15:49.228137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c56ae5ac-d1cf-4938-b1b8-7e9cc11b918f req-af14931a-1420-4497-9991-d780dfe9cef7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057048 Sep 28 12:15:49.229305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 91/192] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:49.351114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:49.351600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:49.368451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.368948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.369384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.370182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.375698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.377135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.388766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:49.390059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:49.399716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.400209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.400661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.404970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.405503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.405942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.581155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.585016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.589059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-45849328-1255-4d27-a4a1-01e18d1c6314 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.242624 Sep 28 12:15:49.589975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 102/193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:49 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:49.593545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5babd122-e52f-4d6b-86ad-453c72a5a20a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.209593 Sep 28 12:15:49.595812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 92/194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:49 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:49.598475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:49.601199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:49.611999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.614765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.616021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.617502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:49.618152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:49.618598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:49.778282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:49.787735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9f97f9e7-0208-4c3c-adce-e43900bb3431 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1322 microversion: 2.1 time: 0.195642 Sep 28 12:15:49.788638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 103/195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:49 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:50.199390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.200101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:50.207275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.208266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.208869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.210008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.210757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.211453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.229628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.231117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:50.241378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.242776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.243526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.244882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.245826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.246535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.470516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.474084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:50.476805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.483723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.485305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.486826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-05112e49-2c09-4b93-b907-4eff012d11d0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.291721 Sep 28 12:15:50.487326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c3877b7b-0a5e-4dde-b544-e50cfd2468c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.264585 Sep 28 12:15:50.487767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 93/196] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:50.492482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 104/197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:50.623296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.624170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:50.624714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.626600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:50.639334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.641665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.642489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.643027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.644144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.644617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.645148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.645724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.646615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.647216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.650447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.651130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.822206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.843796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ae2bdd82-b3ff-4405-9e5b-4bf0408db4b8 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.228025 Sep 28 12:15:50.844569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:50.853424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 105/198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:50.853424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:50.853424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:50.862210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.862210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.862210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.862210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:50.862632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:50.862632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:50.874086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64a90a48-d5ce-4474-b39d-01e568a7eec9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.261010 Sep 28 12:15:50.875162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 94/199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:51.018204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.025952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0b9c0cce-f50e-4af3-9074-84b66ac9b1ed tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1515 microversion: 2.1 time: 0.179926 Sep 28 12:15:51.026527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 106/200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:50 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:51.048380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:51.051045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.057016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.057490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.057918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.058603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.059048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.060031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.127812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lazy-loading 'flavor' on Instance uuid 731779ea-c029-470d-af83-4091842d12f7 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:15:51.247803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb9cef19-b2ac-4ec0-9457-40c2381a14c3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7/action" status: 200 len: 32 microversion: 2.1 time: 0.202765 Sep 28 12:15:51.248512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 95/201] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:15:51 2022] POST /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:15:51.258202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:51.258892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.265257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.265823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.266314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.267084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.267742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.268241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.404096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.411830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0c55346b-56d1-44de-8618-9d6ffb48ab99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.157452 Sep 28 12:15:51.412713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 107/202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:51 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:51.513465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:51.514307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.517976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:51.518595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.521087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.521832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.522458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.523222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.523678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.524095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.525353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.525818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.526255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.527070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.527555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.529433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.679352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.689559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.691043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.692412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1ef6c355-50fd-42d8-82a4-1d226fe0a4a2 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.178676 Sep 28 12:15:51.693469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 108/203] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:51 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:15:51.728083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:51.736091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6c122b31-ab4b-49d2-b394-709bac22cd0b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.227566 Sep 28 12:15:51.736676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 96/204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:51 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:51.869426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:51.870040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.877277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.877764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.878195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.878931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.879385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.879856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.900280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:51.901213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:51.907941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.908664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.909094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:51.910014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:51.910662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:51.911083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.026693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.035169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9039403a-1cb2-494d-b572-4833c2f64264 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.169508 Sep 28 12:15:52.035741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 109/205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:51 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:52.061945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.069539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34b63201-7688-4f89-98d1-9dfda37f12f6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.174325 Sep 28 12:15:52.070098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 97/206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:51 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:52.436189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:52.437084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:52.443056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.443614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.444044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.445020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.445473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.445897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.577947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.587325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6b0baa79-eb00-4dfe-82bc-23dae26a9c0d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.155223 Sep 28 12:15:52.587914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 110/207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:52 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:52.718772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:52.719687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:52.727074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.727562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.727998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.729233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.734099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.735112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.760487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:52.762324 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:52.777035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.780412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.784390 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.786607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.787094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.793253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.810443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:52.935926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.953064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.953064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:52.953064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d38965d2-787d-443f-93da-4fc711a8ba4f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.234429 Sep 28 12:15:52.961020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 98/208] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:52 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:52.973916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9", "name": "network-vif-plugged", "status": "completed", "tag": "cc0af34f-a04e-4ebc-b617-e2310dc4c9c6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:52.984644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:52.985119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:52.985729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:52.999811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] Creating event network-vif-plugged:cc0af34f-a04e-4ebc-b617-e2310dc4c9c6 for instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 on hv-cinder-85919 Sep 28 12:15:53.006355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c27f58ed-f6cd-4e39-af0b-811aac67ba04 req-2417a60a-6607-418e-b681-0ad7a34cc2c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043868 Sep 28 12:15:53.007532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 99/209] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:15:53.058235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:53.059746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:53.066784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.067363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.067798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.068515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.068987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.069403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.087932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:53.097481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1631a16e-89ee-4015-a813-9de976c24c33 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.342162 Sep 28 12:15:53.098130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 111/210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:52 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:53.102488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:53.103162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:53.109455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.109917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.110367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.111046 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.111500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.111921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.314314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:53.325985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-76c5d540-363a-4a9c-b63f-13b3870741de tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.225832 Sep 28 12:15:53.325985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 112/211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:53 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:53.397799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:53.406277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-267f1098-abd8-424b-a51b-2c8bd5ace331 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.352362 Sep 28 12:15:53.406852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 100/212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:53 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:53.612017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:53.612658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:53.618417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.618891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.619304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.619978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.620448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.620867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.750082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:53.757916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6d864419-f2c5-4119-93ee-ceda63f86ea5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.150012 Sep 28 12:15:53.758483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 113/213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:53 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:53.978733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:53.979457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:53.988699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.989223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.989621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:53.990328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:53.991279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:53.991279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.123019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:54.123878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:54.133565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.135042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.136529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.137592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.138269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.138924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.145278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.157627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.160459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.161736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c8376d7-39f5-412e-abcd-9fc97a8ebbfc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.186636 Sep 28 12:15:54.162445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 101/214] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:53 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:54.303732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.314069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ddd6ffae-5a7c-4871-8b8b-724121f77c34 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.197343 Sep 28 12:15:54.314906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 114/215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:54 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:54.350056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:54.350702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:54.357508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.358024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.358472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.359177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.359628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.360053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.431529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:54.432254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:54.439880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.440478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.441055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.442052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.442544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.443026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.591856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.603014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67823368-9cb7-4195-af3c-93eb99d868ce tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.257330 Sep 28 12:15:54.603927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 102/216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:54 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:54.627037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.635455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-96b9ec90-3570-487e-9990-00f5cee3f12f tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.207964 Sep 28 12:15:54.636017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 115/217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:54 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:54.788350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:54.788350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:54.790441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.791042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.792022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.792890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:54.793487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:54.794590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:54.986164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:54.997087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4eef156-f331-4382-82cc-18b8cef04a68 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.219497 Sep 28 12:15:54.998066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 103/218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:54 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:55.187487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:55.188438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:55.191975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:55.200769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.201234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.201662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.202734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.203189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.203609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.337110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:55.337948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:55.343984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.344977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.345566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.346567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.347171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.347831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.353834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.363753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.365213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.366329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d67be251-d90f-4554-83a8-0817372e5124 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.183175 Sep 28 12:15:55.380861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 116/219] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:55 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:55.516618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.524914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31619e8a-f201-41d6-868c-4e5a20257066 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.191614 Sep 28 12:15:55.525573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 104/220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:55 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:55.626525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:55.627322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:55.634152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.634631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.635888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.636605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.637055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.638005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.659953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:55.660585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:55.670006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.670499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.670919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.671605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:55.672346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:55.672911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:55.804934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.813372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1f4991f3-f09a-4c9f-b5ce-fd34fd11d221 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.190830 Sep 28 12:15:55.813958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 117/221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:55 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:55.835206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:55.847406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1de90956-ba7f-46a3-a2cc-ea570691a9fd tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.190691 Sep 28 12:15:55.848900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 105/222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:55 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:56.025634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.026757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:56.033832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.034554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.034982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.035829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.036642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.037070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.185426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.193160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-104217cb-198c-4d57-bb1a-82ad66e6dde0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.171929 Sep 28 12:15:56.193738 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 118/223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:56.391525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.392144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:56.398287 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.398764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.399384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.400261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.400806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.401162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.541005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.548558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.549161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:56.550026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.551455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.552569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc3a7566-eae3-4d32-8605-ed034b15dc8f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.165537 Sep 28 12:15:56.553125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 106/224] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:56.555025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.555498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.555924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.556631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.557078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.557496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.682487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.690541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e5b409be-085c-4552-9f16-c71afbf8d1c1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.145844 Sep 28 12:15:56.691095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 119/225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:56.839115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.839636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:56.846493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.846962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.847388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.848061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.848539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.848958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.875700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:56.876299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:56.882164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.882630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.883053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.883726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:56.884170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:56.884607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:56.978792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:56.987030 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88e31b51-30d4-4dd4-93fc-2f9afb5a82b6 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.151866 Sep 28 12:15:56.987599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 107/226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:57.010819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.018370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ae354487-997b-447b-9754-919f72f4f80c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.147079 Sep 28 12:15:57.018959 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 120/227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:56 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:57.217245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:57.217844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:57.224576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.225065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.225498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.226220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.226670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.227095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.350085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.358138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64d2d240-27c7-4732-8a0b-029843524519 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.144793 Sep 28 12:15:57.358706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 108/228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:57 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:57.578822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:57.579695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:57.586204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.586687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.587113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.587796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.588240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.588685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.712543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:57.713150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:57.717824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.719814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.720286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.720743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.721452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:57.721899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:57.722314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:57.726350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:15:57.727126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.728509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.729614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4cfa06b9-6164-49f5-92d4-106767e0753f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.155569 Sep 28 12:15:57.730199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 121/229] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:57 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:57.961485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:57.970327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80e1c4aa-c031-4eb1-950b-6f5e2c741713 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.261632 Sep 28 12:15:57.974136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 109/230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:57 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:58.009983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:58.010587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:58.016970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.017438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.017862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.018534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.018979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.019396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.041170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:58.041786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:58.047961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.048480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.048918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.049614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.050076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.050500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.149979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.159547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b85e2738-839d-49db-bd7c-9e3063c24648 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.153343 Sep 28 12:15:58.160124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 122/231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:58 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:58.187458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.195634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4d085c54-c3bf-4319-aa2b-e7ece5028157 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.158260 Sep 28 12:15:58.196227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 110/232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:58 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:58.380748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:58.381363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:58.387021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.387504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.387937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.388797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.389321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.389918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.537393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.546325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a44353f1-d4cd-4cb1-9945-c1d5f0fee20e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.169276 Sep 28 12:15:58.547026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 123/233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:58 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:58.755221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:58.757299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:58.763678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.764146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.764602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.765283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:58.765727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:58.766141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:58.900513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.908484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.909902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:58.910982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52860eb6-37aa-4f3c-9916-a87844b45afa tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.159891 Sep 28 12:15:58.911535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 111/234] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:58 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:15:58.992814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:58.993368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:59.000056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.000610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.001034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.001706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.002146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.002560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.128350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:59.136504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3e3c59ef-a37f-4732-85dc-4fd6bca305a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.147349 Sep 28 12:15:59.137551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 124/235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:58 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:59.182635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:59.183248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:59.189167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.189654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.190088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.190780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.191233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.191656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.219040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:59.219913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:59.226272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.226755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.227189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.228056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.228746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.228973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.397052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:59.405449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-29ebc7e2-63e4-4868-b25a-721284d9b60b tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1361 microversion: 2.1 time: 0.190602 Sep 28 12:15:59.406033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 125/236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:59 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:15:59.467875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:59.484490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2d71e2b-22d9-47c7-948e-3fde651a1650 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1314 microversion: 2.1 time: 0.302155 Sep 28 12:15:59.484490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 112/237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:59 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:15:59.580191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:59.580191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:59.580191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.580191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.580541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.580541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.580541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.580541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.822790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300ee327-113a-408e-8cee-099a7cc2a0ee", "name": "network-vif-plugged", "status": "completed", "tag": "6d023a29-0ce0-422c-af0f-9f34e992320e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:15:59.842563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.843223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.845504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.869591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] Creating event network-vif-plugged:6d023a29-0ce0-422c-af0f-9f34e992320e for instance 300ee327-113a-408e-8cee-099a7cc2a0ee on hv-cinder-85919 Sep 28 12:15:59.883211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-37b2c3f3-b1cd-4880-94f0-5cffd373c33e req-0e27a170-7785-4867-8bc5-33c492178184 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066257 Sep 28 12:15:59.885044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 113/238] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:15:59.926482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:15:59.937210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:15:59.938088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:15:59.938854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b82df3e4-5b55-40af-90a1-49bf3a5a8706 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.372754 Sep 28 12:15:59.945529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.946244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.946826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.948286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:15:59.949229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:15:59.950516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:15:59.955789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 126/239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:15:59 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:00.096188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.104525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.105974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.107594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ccf7b37-476d-49ec-981e-716a71b0e713 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.176058 Sep 28 12:16:00.108152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 114/240] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:15:59 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:00.162242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:00.162846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:00.169511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.169981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.170574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.171261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.171707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.172130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.302238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.305651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:00.310898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0b74348e-8a3e-43af-ba0c-e3d0d3b86af7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.152527 Sep 28 12:16:00.311466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 127/241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:00 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:00.428550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:00.429161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:00.435221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.435701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.436143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.436866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.437323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.437753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.505377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:00.505982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:00.511893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.512956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.513399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.514078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.514527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.514937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.571967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.584703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7cddb08b-fd09-4016-bfc8-ec229c074c83 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1547 microversion: 2.1 time: 0.159876 Sep 28 12:16:00.585945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 115/242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:00 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:00.608710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:00.610411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:00.617646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.618345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.618932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.619997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.620649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.621456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.671065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:00.680275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-12d2c5a5-52d5-49c3-a84c-7b7825a81108 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1501 microversion: 2.1 time: 0.178778 Sep 28 12:16:00.681470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 128/243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:00 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:00.777773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-600a6a31-2cff-45cf-abc1-9dede6af42b3 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173359 Sep 28 12:16:00.778663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 116/244] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 28 12:16:00 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:00.963067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:00.963673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:00.973808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.974633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.975330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:00.976258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:00.977162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:00.977794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:01.133755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:01.140192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:01.140837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:01.142264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-273367a8-bc96-48fe-a430-420d89cf5983 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.183118 Sep 28 12:16:01.142864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 129/245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:00 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:01.144499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:01.148384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:01.149280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:01.149716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:01.150403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:01.150851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:01.151261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:01.334245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:01.334995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:01.340921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:01.341395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:01.341826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:01.342567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:01.342964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:01.343383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:01.372225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:01.383886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:01.385339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:01.386445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14614ff7-d020-484c-965b-e598c2d110cd tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.257170 Sep 28 12:16:01.386998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 117/246] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:01 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:01.497000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:01.504696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-78c5c7e4-5083-4ae8-b19b-db04c630051d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.174223 Sep 28 12:16:01.505263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 130/247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:01 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:02.166410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:02.167049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:02.175021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.175532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.176012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.176787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.177417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.177864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.183237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dafad59-8746-4b43-9873-444b28b0da27", "tag": "5d5dc8e7-99bd-40f3-8aca-1ca4833608cf"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:02.198234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.199431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.199431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.216327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] Creating event network-changed:5d5dc8e7-99bd-40f3-8aca-1ca4833608cf for instance 7dafad59-8746-4b43-9873-444b28b0da27 on hv-cinder-85919 Sep 28 12:16:02.222262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-16fbed21-11b0-4813-a92f-5502646f233b req-274d1d7d-826d-4224-a857-dbbfaef17bd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042457 Sep 28 12:16:02.222865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 131/248] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:02.317983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:02.326074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e100ce5-2d75-48bb-929f-485fa907853d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.164880 Sep 28 12:16:02.326649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 118/249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:02 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:02.413859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:02.414464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:02.420515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.421017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.421449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.422124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.422568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.422984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.528734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:02.529358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:02.535580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.539355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.539796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.541104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:02.541104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:02.541417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:02.566215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:02.577860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:02.579843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:02.581201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fa7d12b7-35d8-4d80-9944-c02f4cb4f2f6 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.171605 Sep 28 12:16:02.581874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 132/250] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:02 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:02.684452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:02.691967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c66acd76-bd40-4074-b4ca-da5a151f19e8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.167855 Sep 28 12:16:02.692566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 119/251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:02 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:03.349931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:03.350918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:03.357338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.357819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.358256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.358945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.359397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.359824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.489792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:03.498357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-507a6c88-e11d-420e-a78c-8e221cb484dc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.152268 Sep 28 12:16:03.498918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 133/252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:03 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:03.607403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:03.608038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:03.613961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.614435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.614870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.615558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.616010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.616454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.715002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:03.716114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:03.722209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.722684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.723111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.723793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:03.724237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:03.724685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:03.743310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:03.751642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:03.753192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:03.754410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-954c8cf1-a4b0-4142-93da-93de49b86837 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.151443 Sep 28 12:16:03.755052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 120/253] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:03 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:03.854712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:03.863220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b1d2f60f-61ba-43ea-a558-bb0822c1da7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.152035 Sep 28 12:16:03.863787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 134/254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:03 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:04.521257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:04.521805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:04.527869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.528398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.528808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.529489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.529943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.530364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.708973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:04.717061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c9f2b97-e3c7-4b0a-adac-f02060c9858a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.199661 Sep 28 12:16:04.717743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 121/255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:04 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:04.778995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:04.779595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:04.785449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.785926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.786350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.787025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.787466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.787884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.885958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:04.886666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:04.892661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.893215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.893708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.894471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:04.894995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:04.895482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:04.911731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:04.920298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:04.921932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:04.923037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d0314282-2c2b-45b8-8eab-10a01db7effb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.147988 Sep 28 12:16:04.923589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 135/256] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:04 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:05.021838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:05.029900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a479a897-dfaf-462d-ae03-b66f7ab2da7c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1366 microversion: 2.1 time: 0.147777 Sep 28 12:16:05.030588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 122/257] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:04 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:05.279998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c5f61b6-2169-4ae6-8034-8d8dca3a022f"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:05.289690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:05.313754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:05.315315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:05.315315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:05.315481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:05.315859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:05.316279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:05.739869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:05.740514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:05.746435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:05.747405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:05.747837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:05.748554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:05.749038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:05.749463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:05.990610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:05.999309 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aab5f099-b911-43db-b8c8-06d421b6255a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.263205 Sep 28 12:16:06.013063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 123/258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:05 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:06.021047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:06.021974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:06.041096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.041514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.042043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.042742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.043188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.044215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.175495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:06.183689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:06.185780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:06.186884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6dccf62-6985-4d6f-9cb5-a01903bbb317 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.172709 Sep 28 12:16:06.187438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 124/259] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:06 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:06.199381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:06.199381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:06.199381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.199381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.200000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.200000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.200240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.200854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.330856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:06.338501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f0a3b04-6c3b-4f46-b8c1-09e0131bc37b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1556 microversion: 2.1 time: 0.150060 Sep 28 12:16:06.339070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 125/260] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:06 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:06.361692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:06.362181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:06.368054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.368520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.369023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.369721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:06.370178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:06.370690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:06.446083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb9f28c5-9340-44dc-92f7-c68452a948a0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087963 Sep 28 12:16:06.446724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 126/261] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 28 12:16:06 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:06.954002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-46395566-1d62-4caa-8ad2-285b7860ecb9 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "POST /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.678341 Sep 28 12:16:06.957294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 136/262] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 28 12:16:05 2022] POST /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e/os-volume_attachments => generated 194 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:07.026877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:07.027487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:07.033576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:07.034264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:07.034862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:07.035754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:07.036563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:07.037556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:07.054557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:07.213204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:07.213849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:07.225885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:07.226397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:07.227182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:07.228284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:07.228789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:07.229248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:07.398877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:07.414708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:07.417536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c645887-b9bb-4ba3-9784-a269477c7409 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.393209 Sep 28 12:16:07.419210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 127/263] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:07 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:07.434789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:07.437147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:07.438288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ee9976bd-2182-453f-bd79-da9d1ab42912 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.230746 Sep 28 12:16:07.438857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 137/264] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:07 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:08.157175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9", "tag": "cc0af34f-a04e-4ebc-b617-e2310dc4c9c6"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:08.167848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:08.169252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:08.169788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:08.182735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] Creating event network-changed:cc0af34f-a04e-4ebc-b617-e2310dc4c9c6 for instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 on hv-cinder-85919 Sep 28 12:16:08.188302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-373b5a0c-3df1-49f7-a7de-f863c5806968 req-67e65303-bd1d-43e9-a2ff-e038ff96e0ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035239 Sep 28 12:16:08.189061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 128/265] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:08.442024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:08.443576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:08.454142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:08.454975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:08.468614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:08.470084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:08.471541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:08.472333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:08.475670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:08.477532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:08.500830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:08.502368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:08.503342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:08.504362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:08.505431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:08.506113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:08.697692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:08.723470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-63ffafb2-d3d3-43e7-870c-12fac690a4fb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.283852 Sep 28 12:16:08.724269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 138/266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:08 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:08.801384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:08.812728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:08.814591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:08.816893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0512fb81-a812-43d9-b1eb-6d8584d872d4 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1406 microversion: 2.20 time: 0.356420 Sep 28 12:16:08.817925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 129/267] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:08 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:16:09.749389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:09.750792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:09.761853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:09.764255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:09.765101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:09.766048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:09.766670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:09.767257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:09.852707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:09.854122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:09.863035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:09.863527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:09.864036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:09.864846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:09.865108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:09.865524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:10.065694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:10.068935 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:10.099630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9e9cbc50-c7bb-4c4f-8628-a8f21f72bdb1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.354726 Sep 28 12:16:10.100275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 139/268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:09 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:10.126331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:10.130711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:10.139469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cee4024e-93f1-4c17-aed6-b038c6a39358 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1598 microversion: 2.20 time: 0.285824 Sep 28 12:16:10.141975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 130/269] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:16:09 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1598 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:16:10.177654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:10.180050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:10.203272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:10.203841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:10.204556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:10.205480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:10.208113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:10.210198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:10.442927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-311cb0e4-2794-424e-a9eb-a3fac4b84d4d tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.269620 Sep 28 12:16:10.443529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 140/270] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Sep 28 12:16:10 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee/os-interface => generated 285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:16:11.125670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:11.126293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:11.134458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:11.135076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:11.135905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:11.136637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:11.138170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:11.139360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:11.447734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:11.468233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2b442bf-62cb-44ce-9a56-ee3fe143e074 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.347158 Sep 28 12:16:11.471133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 131/271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:11 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:12.020191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "300ee327-113a-408e-8cee-099a7cc2a0ee", "tag": "6d023a29-0ce0-422c-af0f-9f34e992320e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:12.053516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:12.054458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:12.055133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:12.071123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] Creating event network-changed:6d023a29-0ce0-422c-af0f-9f34e992320e for instance 300ee327-113a-408e-8cee-099a7cc2a0ee on hv-cinder-85919 Sep 28 12:16:12.082348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-e4620c53-80a4-4fcf-91e8-fa10510a17d8 req-24f62ef4-39a9-45b6-a3b1-d1b35a93840f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065856 Sep 28 12:16:12.091249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 141/272] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:12.498239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:12.498619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:12.523796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:12.524440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:12.528841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:12.530139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:12.531508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:12.532506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:12.897928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:12.908255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-410fa6fa-d4af-4c52-aa7a-749b1faa0879 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.415012 Sep 28 12:16:12.909780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 132/273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:12 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:13.933553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:13.935596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:13.943790 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:13.944613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:13.948730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:13.949836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:13.950462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:13.951047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:14.138647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:14.146802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0c16e927-8939-4151-bc2c-61c80917e8e6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.218258 Sep 28 12:16:14.148113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 142/274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:13 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:15.176854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:15.177578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:15.189910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:15.192573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:15.194127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:15.194993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:15.197758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:15.201654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:15.476431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:15.506336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a54f267-88e2-41ba-a718-0e33eb520010 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.336429 Sep 28 12:16:15.507548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 133/275] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:15 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:16.532358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:16.533764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:16.540982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:16.541468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:16.541908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:16.542610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:16.543123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:16.543610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:16.700589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:16.710244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f202df48-a589-4dfd-a6cb-4e1fab1a9c33 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.181883 Sep 28 12:16:16.710568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 143/276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:16 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:17.070642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1179317601", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "networks": [{"uuid": "782c583b-c846-4f7d-aadd-b220332f6290"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:17.090728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:17.095097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:17.101700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.102348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.103015 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.103709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.104158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.104609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.160142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] validate_networks() for [('782c583b-c846-4f7d-aadd-b220332f6290', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:16:17.160905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:16:17.195673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:17.341214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3cf2ac60-8410-4c60-a7b2-bb3d723488d4 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 204 len: 0 microversion: 2.1 time: 0.254563 Sep 28 12:16:17.346087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 144/277] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:16:17 2022] DELETE /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:16:17.352518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:17.353516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:17.363716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.365503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.366872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.368093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.368995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.369743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.653666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:17.681243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7dadd5db-6d7f-4992-b651-06b7c5139aab tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1553 microversion: 2.1 time: 0.333389 Sep 28 12:16:17.684483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 145/278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:17 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:17.734070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:17.734670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:17.744278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.744278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.744278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.744278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.744754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.745460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.752048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:16:17.755678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:16:17.756283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:16:17.757882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:16:17.759375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:16:17.774813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.775448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.776011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.776947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:17.777758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:17.778319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:17.814481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Getting quotas for project 9fedaf31a9b64cbfb658837f17204f66. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:16:17.819347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Getting quotas for user 7e428194fecb425fb4e1264ce6c49051 and project 9fedaf31a9b64cbfb658837f17204f66. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:16:17.840236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:16:17.855320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:16:17.919787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b6a886b-d020-4235-9582-9940d78de3a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852888 Sep 28 12:16:17.921866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 134/279] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:16:17.937950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8add9578-3394-4a01-aeeb-0290047539b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:17.939755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8add9578-3394-4a01-aeeb-0290047539b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:18.022646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8add9578-3394-4a01-aeeb-0290047539b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:18.022856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:18.034549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e9502441-4b46-4aff-aef2-49b7e8e7c47f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.303802 Sep 28 12:16:18.037595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8add9578-3394-4a01-aeeb-0290047539b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1219 microversion: 2.1 time: 0.107487 Sep 28 12:16:18.043111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 146/280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:17 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:18.057944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 135/281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:17 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:18.708639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:18.710238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:18.719274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:18.720809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:18.721515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:18.722516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:18.723042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:18.723439 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:18.941132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:18.950912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6690adaf-374b-4ca9-95ef-54a1c31b6d4e tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1553 microversion: 2.1 time: 0.246458 Sep 28 12:16:18.951666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 147/282] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:18 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:19.060188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:19.061670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:19.067850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:19.068543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:19.069076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:19.069934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:19.070479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:19.070997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:19.083115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:19.084178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:19.110721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:19.111273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:19.111938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:19.113690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:19.114348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:19.115759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:19.238460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:19.254027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9a53a215-5470-4f88-b466-7a46e555adfc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1223 microversion: 2.1 time: 0.174442 Sep 28 12:16:19.264372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 148/283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:19.301544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:19.310748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c655391-a5fd-47c8-bbdf-ec65a821dd60 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.255624 Sep 28 12:16:19.311603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 136/284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:19 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:19.984022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:19.984758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:19.993146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:19.994652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:19.995558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.003049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:20.003541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:20.003986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.283340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:20.284685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:20.296276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:20.297572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:20.299506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.300296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:20.300994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:20.301819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.309182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:20.318781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-405a9a45-d0ef-4fae-9e84-03eb7a7a860b tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1553 microversion: 2.1 time: 0.347159 Sep 28 12:16:20.319353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 149/285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:19 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:20.334637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:20.337411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:20.354460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:20.356382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:20.357350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.361308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:20.362492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:20.364213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:20.509877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:20.536722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-04e6319b-8c7d-4659-89e7-f7a6d8d1320c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1271 microversion: 2.1 time: 0.258880 Sep 28 12:16:20.557720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 137/286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:20.807575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:20.818813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1dd7d8b3-7b47-4882-b79f-b98e19958a06 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.487794 Sep 28 12:16:20.824208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 150/287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:20 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:21.345128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.345738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:21.364902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.379134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.379860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.383315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.390195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea91ff5b-8157-441e-a031-545af552cb3e", "name": "network-vif-deleted", "tag": "7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:21.394889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.395334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.427294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.428297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.430141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.573479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:21.590775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd21e8d7-55a6-4205-9ec0-2b7c4570d743 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1511 microversion: 2.1 time: 0.246059 Sep 28 12:16:21.595202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 138/288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:21.608570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.613429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:21.633060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.633716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.639885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.640796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.644824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.645426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.818228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] Creating event network-vif-deleted:7a18fb35-85e4-4a2d-aa13-d4b8ea9729f8 for instance ea91ff5b-8157-441e-a031-545af552cb3e on hv-cinder-85919 Sep 28 12:16:21.824114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-63169cbe-6b2a-46f0-84be-6d9771e7b2b7 req-4a67a946-1a6a-4f4d-a9e5-17c62043e979 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437987 Sep 28 12:16:21.826413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 151/289] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:21.832944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:21.848289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0f61c2e-5b66-48b2-b7c5-6bf479797d59 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1277 microversion: 2.1 time: 0.251659 Sep 28 12:16:21.851525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 139/290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:21.855093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:21.856731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:21.872902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.873730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.874393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:21.875503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:21.876226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:21.877236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.570053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:22.579425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4838b0f1-5147-493e-8f61-21d6de43de58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.735208 Sep 28 12:16:22.583774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 152/291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:21 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:22.622576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:22.623436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:22.632621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:22.633784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:22.634301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.635250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:22.635944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:22.636616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.689409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:22.690136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:22.690806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.691459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lazy-loading 'fault' on Instance uuid ea91ff5b-8157-441e-a031-545af552cb3e {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:16:22.738606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0e4c6131674b3799a374aacdec708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6090ef3dd4494004b0156e49bbeb9273', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:22.749136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b72eae11-a999-4538-bdd8-77407805a2a2 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 200 len: 1350 microversion: 2.1 time: 0.130735 Sep 28 12:16:22.750953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 140/292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:22 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:22.879019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:22.879240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:22.887448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:22.888162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:22.888809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.889748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:22.890412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:22.890912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:22.986540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:22.998430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4f1cc0d2-fe88-4a20-b973-f05208824d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1277 microversion: 2.1 time: 0.127203 Sep 28 12:16:22.999961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 153/293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:22 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:23.607162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.607696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:23.615954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.616514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.616945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.617659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.618108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.618530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.774253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:23.776486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.779270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:23.792222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e7142e2-acdf-446a-a4a6-728bf950a027 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.188933 Sep 28 12:16:23.796093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 141/294] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:23.797683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.798253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.798860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.799568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.800018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.800465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.821365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] HTTP exception thrown: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Request method failure captured: Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e HTTP/1.1 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrAKaUxSZA6sQ2Weoppe5enuzg7R3lCjacF2dPIJKRal-_2LuqvsKlwab0q9XNizFs9KpwyA30yWsFlL85ZkCwROrYIVEbMJi4v-47YK_wovAkJlT1ppZwSgdRwHU1EUlxBg355a3gh340Gv08yoTTI81OCdeYvUuS5ZEZ9IfY_oV0 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:16:23.828214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6090ef3dd4494004b0156e49bbeb9273", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 3b0e4c6131674b3799a374aacdec708f Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:23.829704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'ea91ff5b-8157-441e-a031-545af552cb3e'} Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:23.830415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:23.831481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:23.834148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Returning 404 to user: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:23.835244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c31eab08-ea70-48b8-bd8b-29b6b4c588df tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 404 len: 111 microversion: 2.1 time: 0.063957 Sep 28 12:16:23.836395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 154/295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:23.968715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:23.971251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:23.977702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.978145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.978602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.979235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:23.979679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:23.980261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:23.995089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] HTTP exception thrown: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Request method failure captured: Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e/os-volume_attachments HTTP/1.1 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrAKaUxSZA6sQ2Weoppe5enuzg7R3lCjacF2dPIJKRal-_2LuqvsKlwab0q9XNizFs9KpwyA30yWsFlL85ZkCwROrYIVEbMJi4v-47YK_wovAkJlT1ppZwSgdRwHU1EUlxBg355a3gh340Gv08yoTTI81OCdeYvUuS5ZEZ9IfY_oV0 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:16:24.000835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6090ef3dd4494004b0156e49bbeb9273", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 3b0e4c6131674b3799a374aacdec708f Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:24.002418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'server_id': 'ea91ff5b-8157-441e-a031-545af552cb3e'} Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:24.003242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:24.004587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:24.006693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Returning 404 to user: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:24.007554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-009d84c5-1e68-4e43-8a8f-7d08156d096a tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043435 Sep 28 12:16:24.011369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 142/296] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:16:23 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:24.023125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:24.023732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:24.034240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:24.035144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:24.036665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:24.037729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:24.038372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:24.039071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:24.417698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:24.425431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9852d875-0e19-46b0-8229-478113e92f98 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.406158 Sep 28 12:16:24.425989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 155/297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:24.676667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70275a6-f5ea-4b01-b384-32c64c06551d", "tag": "c0641157-82d8-42ba-a37f-1a65ad219c3a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:24.689195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:24.689946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:24.690771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:24.705557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] Creating event network-changed:c0641157-82d8-42ba-a37f-1a65ad219c3a for instance f70275a6-f5ea-4b01-b384-32c64c06551d on hv-cinder-85919 Sep 28 12:16:24.711027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f71a0be8-7036-4bed-9204-63d11b7a3bc6 req-fa7f1c50-c8ba-4c54-af4b-f5f031c13b31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039883 Sep 28 12:16:24.712335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 143/298] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:24.817976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:24.819563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:24.826887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:24.827367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:24.827908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:24.835410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:24.835885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:24.837640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.140999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:25.154626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-36d8deb8-096c-47f2-ab4e-e5a4ddf476f5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.340409 Sep 28 12:16:25.155601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 156/299] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:24 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:25.282490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.284341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:25.294742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.295428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.296011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.296895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.297490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.298091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.315903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] HTTP exception thrown: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Request method failure captured: Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e HTTP/1.1 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrAKaUxSZA6sQ2Weoppe5enuzg7R3lCjacF2dPIJKRal-_2LuqvsKlwab0q9XNizFs9KpwyA30yWsFlL85ZkCwROrYIVEbMJi4v-47YK_wovAkJlT1ppZwSgdRwHU1EUlxBg355a3gh340Gv08yoTTI81OCdeYvUuS5ZEZ9IfY_oV0 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:16:25.318941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6090ef3dd4494004b0156e49bbeb9273", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 3b0e4c6131674b3799a374aacdec708f Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.320148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': 'ea91ff5b-8157-441e-a031-545af552cb3e'} Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:25.320855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.321927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.325093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Returning 404 to user: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:25.326091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7ed3ea8-3075-417d-93b3-23dfdd97270c tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 404 len: 111 microversion: 2.1 time: 0.049956 Sep 28 12:16:25.327153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 144/300] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:16:25 2022] DELETE /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:25.345100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.345779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] [instance: ea91ff5b-8157-441e-a031-545af552cb3e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:25.352174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:25.353720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.354204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.354637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.355377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.356818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.357269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.376105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] HTTP exception thrown: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Request method failure captured: Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e HTTP/1.1 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrAKaUxSZA6sQ2Weoppe5enuzg7R3lCjacF2dPIJKRal-_2LuqvsKlwab0q9XNizFs9KpwyA30yWsFlL85ZkCwROrYIVEbMJi4v-47YK_wovAkJlT1ppZwSgdRwHU1EUlxBg355a3gh340Gv08yoTTI81OCdeYvUuS5ZEZ9IfY_oV0 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:16:25.377986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6090ef3dd4494004b0156e49bbeb9273", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6090ef3dd4494004b0156e49bbeb9273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 6090ef3dd4494004b0156e49bbeb9273 Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-DeleteServersTestJSON-24714508 Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 3b0e4c6131674b3799a374aacdec708f Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-DeleteServersTestJSON-24714508-project Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.381481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'ea91ff5b-8157-441e-a031-545af552cb3e'} Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:25.382276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. Sep 28 12:16:25.383635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:25.385848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] Returning 404 to user: Instance ea91ff5b-8157-441e-a031-545af552cb3e could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:25.386976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-27da44b1-f444-4b2b-8df3-a8885772eab3 tempest-DeleteServersTestJSON-24714508 tempest-DeleteServersTestJSON-24714508-project] 10.222.0.26 "GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e" status: 404 len: 111 microversion: 2.1 time: 0.055239 Sep 28 12:16:25.388071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 157/301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/servers/ea91ff5b-8157-441e-a031-545af552cb3e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:25.448479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:25.449423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:25.457873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.458707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.459373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.460528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:25.461189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:25.461813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:25.700597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:25.711944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5e6548e2-49de-4da5-b6ff-c9078b6b7e9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.267217 Sep 28 12:16:25.713684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 145/302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:26.178792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:26.178792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:26.186177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:26.186655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:26.187080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:26.199877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:26.200388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:26.200830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:26.432184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:26.445268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a4eb401-be3e-40b6-bdf2-396ee79a47a6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.270741 Sep 28 12:16:26.447001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 158/303] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:26 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:26.737108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:26.739462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:26.750709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:26.751991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:26.752652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:26.755893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:26.756602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:26.757180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:26.986976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:26.999683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-44852f91-dbdc-4645-869a-18cfd6019321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.266232 Sep 28 12:16:27.001400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 146/304] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:27.474702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:27.475851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:27.490357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:27.491124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:27.491734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:27.495751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:27.496839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:27.497281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:27.879929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:27.891676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd7889aa-c401-4a27-a08d-b876c590c501 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.421015 Sep 28 12:16:27.894478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 159/305] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:27 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:28.022895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:28.023509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:28.034582 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:28.035406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:28.036951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:28.037519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:28.037978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:28.040083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:28.040686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:28.041400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:28.313144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:28.320403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:28.330856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92a758d1-fb9f-4f46-b47c-6634a5e449b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.311667 Sep 28 12:16:28.331446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 147/306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:28.918361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:28.918923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:28.928632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:28.930986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:28.933484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:28.934493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:28.937110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:28.937612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:29.356618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:29.358143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:29.364690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:29.365427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:29.366003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:29.366978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:29.367877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:29.368549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:29.514812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:29.525479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c885032d-5557-439d-8fb3-ea9e04d4f2e1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.611236 Sep 28 12:16:29.528014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:29.529117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 160/307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:28 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:29.536796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80a46002-79a2-4bd8-b31f-50a1779423c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.183978 Sep 28 12:16:29.537896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 148/308] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:30.558156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:30.559529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:30.571216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:30.571829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:30.583809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:30.587179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:30.589766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:30.590048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:30.591607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:30.592531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:30.593460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:30.594357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:30.596130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:30.596817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:30.597444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:30.598179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:30.965539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:30.968924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:30.977225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fe9dcf7a-32ec-4cf1-b303-ccf59c98289b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.422865 Sep 28 12:16:30.978770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 161/309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:30 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:31.037490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:31.050832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73d4b1e2-7037-41c9-8b81-a662b32d2a54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.484190 Sep 28 12:16:31.052596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 149/310] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:30 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:31.147764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70275a6-f5ea-4b01-b384-32c64c06551d", "name": "network-vif-plugged", "status": "completed", "tag": "c0641157-82d8-42ba-a37f-1a65ad219c3a"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:31.169207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:31.169921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:31.170522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:31.186122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] Creating event network-vif-plugged:c0641157-82d8-42ba-a37f-1a65ad219c3a for instance f70275a6-f5ea-4b01-b384-32c64c06551d on hv-cinder-85919 Sep 28 12:16:31.195245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-de05648c-6ca5-4144-be59-0aeae1933886 req-ac688a2d-e753-4d5e-bd8e-82eb36bad165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052912 Sep 28 12:16:31.197006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 162/311] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:32.002632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:32.003846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:32.009756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:32.012880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:32.013661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:32.015222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:32.016334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:32.017031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:32.017692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:32.083651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:32.085479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:32.093623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:32.095132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:32.095793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:32.097228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:32.098033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:32.099583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:32.176078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:32.196207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02c6fef0-69dd-40ec-83c4-5c2665a6173c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.198001 Sep 28 12:16:32.196899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 150/312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:31 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:32.287977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:32.300787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-35850d6c-e38c-4f69-b96a-9b6cfeacf8be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1319 microversion: 2.1 time: 0.222946 Sep 28 12:16:32.301357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 163/313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:32.993790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-323b4b89-994f-4ddf-8937-3e7c81d164ca tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Action: 'create', calling method: .version_select at 0x7f30627ac940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-412445701"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:33.224553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:33.226490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:33.238799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:33.239460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:33.240097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:33.241159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:33.241460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:33.241887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:33.442476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:33.455021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-323b4b89-994f-4ddf-8937-3e7c81d164ca tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.601656 Sep 28 12:16:33.456321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 151/314] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Sep 28 12:16:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 604 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 12:16:33.460915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:33.461710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:33.466666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c2637fbf-94f2-444b-a6db-5907a2ad464a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.237876 Sep 28 12:16:33.467539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 164/315] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:33 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:33.473671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:33.474158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:33.474616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:33.475230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5be481a7-b6a0-4e2c-bbc4-32bf8d0de29f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f3062761310>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:33.475363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:33.475741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:33.479977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:33.599375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5be481a7-b6a0-4e2c-bbc4-32bf8d0de29f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.130317 Sep 28 12:16:33.600186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 165/316] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:33 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:33.649087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:33.657618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72f807ca-0b9f-4e73-ae34-0e86b8d9ae92 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1509 microversion: 2.1 time: 0.200171 Sep 28 12:16:33.658476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 152/317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:34.494781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:34.497386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:34.504071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:34.504836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:34.505275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:34.506457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:34.507559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:34.507972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:34.614109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48aa90eb-e509-4f4f-9203-be3e9dc6b85c tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306270a4c0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:34.669637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:34.678575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48aa90eb-e509-4f4f-9203-be3e9dc6b85c tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.068388 Sep 28 12:16:34.679328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 153/318] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:34 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:34.681183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c23d176b-49cd-4f93-9571-ce4b8de49d75 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.190722 Sep 28 12:16:34.682218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 166/319] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:34 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:35.694951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65b655b8-c62a-45a1-9a3d-92e00c79ed40 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306270a8b0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:35.707853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:35.709101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:35.718591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:35.719394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:35.720287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:35.722293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:35.725637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:35.726487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:35.763220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65b655b8-c62a-45a1-9a3d-92e00c79ed40 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 345 microversion: 2.1 time: 0.072524 Sep 28 12:16:35.764154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 154/320] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:35 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:35.779997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9dd3df97-086d-41ad-b165-b30ab09ec066 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Action: 'create', calling method: .version_select at 0x7f306271e3a0>, body: {"snapshot": {"volume_id": "c13a984b-eb3a-4e2a-9eac-c3380f398e6f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1273222972"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:35.943931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:35.956473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-df59e816-a9d2-4674-b630-91654879a22f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.254221 Sep 28 12:16:35.957446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 167/321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:35 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:36.030012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9dd3df97-086d-41ad-b165-b30ab09ec066 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.255886 Sep 28 12:16:36.030780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 155/322] 10.222.0.26 () {60 vars in 1162 bytes} [Wed Sep 28 12:16:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:36.041823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4e94789e-8ffe-4375-bec7-c6d4a7a1baf8 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30627613a0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:36.078703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4e94789e-8ffe-4375-bec7-c6d4a7a1baf8 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.040710 Sep 28 12:16:36.079339 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 168/323] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:36 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:36.099616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e79fb9b-aef8-4301-9a81-9f58a5c30eea tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306271e9d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:36.177872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e79fb9b-aef8-4301-9a81-9f58a5c30eea tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.091144 Sep 28 12:16:36.178832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 156/324] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Sep 28 12:16:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:36.193994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8fd69a0-c05c-4703-a68e-6441e3850390 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306275cca0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:36.263422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8fd69a0-c05c-4703-a68e-6441e3850390 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.074687 Sep 28 12:16:36.264165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 169/325] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:36 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:36.985881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:36.986580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d402564-c805-43d3-8586-578d4921ca4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'create', calling method: .version_select at 0x7f306270ad30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-581878132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrEX+aAzreNyQKRVZ1tLH5pCrIOAxFO2ahgs0W2/a5Y4fqxnjW4qGCohl5rud/icntrqFGTigNYusnSVAlFX6Ka4SUyIdH3ktuJOooMdAqZ7khAyhOGCBjZn1higUbvRA=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:36.987030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:36.993739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:36.994220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:36.994649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:36.995341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:36.995843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:36.996266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:37.004142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-1d402564-c805-43d3-8586-578d4921ca4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Getting quotas for project e271418048c1466e948bf84de04fc05f. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:16:37.008017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-1d402564-c805-43d3-8586-578d4921ca4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Getting quotas for user 4226c61349b440c3a502a7cbc592d883 and project e271418048c1466e948bf84de04fc05f. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:16:37.038242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d402564-c805-43d3-8586-578d4921ca4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056187 Sep 28 12:16:37.038840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 157/326] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:16:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:37.130059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:37.138274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-653538da-dec8-4a29-8d7b-37832b9242a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.156131 Sep 28 12:16:37.138933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 170/327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:36 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:37.198154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-178636063", "imageRef": "685fa74c-5209-479f-8c76-594eb3a74897", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-581878132", "networks": [{"uuid": "4b160051-5316-4220-9334-e9de5e3bd300"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:37.249380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] validate_networks() for [('4b160051-5316-4220-9334-e9de5e3bd300', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:16:37.276857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3ed1c535-4e7d-4abe-a3ef-95f0870fceb1 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30627628b0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:37.307180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3ed1c535-4e7d-4abe-a3ef-95f0870fceb1 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.034033 Sep 28 12:16:37.307957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 171/328] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:37 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:37.610454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:16:37.610870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:16:37.611335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:16:37.611734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:16:37.612168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:16:37.621470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:37.621945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:37.622369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:37.623080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:37.623522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:37.623936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:37.639907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Getting quotas for project e271418048c1466e948bf84de04fc05f. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:16:37.643890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Getting quotas for user 4226c61349b440c3a502a7cbc592d883 and project e271418048c1466e948bf84de04fc05f. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:16:37.654616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:16:37.656759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='685fa74c-5209-479f-8c76-594eb3a74897',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:16:37.700911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da1057c0-00d8-4b8d-bee6-0d0eb31b03cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506638 Sep 28 12:16:37.701701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 158/329] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:16:37.712373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-962407be-ec65-425e-9503-349c1ce32ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:37.712975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-962407be-ec65-425e-9503-349c1ce32ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:37.765323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-962407be-ec65-425e-9503-349c1ce32ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:37.772710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-962407be-ec65-425e-9503-349c1ce32ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1257 microversion: 2.1 time: 0.064209 Sep 28 12:16:37.773255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 172/330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:38.161946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:38.162658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:38.170829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:38.171302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:38.171728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:38.172434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:38.172882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:38.173302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:38.304754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:38.312945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cee285a-7127-4b78-8852-8b49f0c7a1e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.155388 Sep 28 12:16:38.313498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 159/331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:38 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:38.320585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a528331-b583-4e37-b077-71b1eb8dfef0 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306275c790>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:38.350871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a528331-b583-4e37-b077-71b1eb8dfef0 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033985 Sep 28 12:16:38.351452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 173/332] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:38 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:38.794751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:38.795357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:38.801773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:38.802251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:38.802681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:38.803364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:38.803812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:38.804235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:38.999335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:39.007013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85016a94-3c70-4525-b66f-4f43992f9850 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1261 microversion: 2.1 time: 0.216028 Sep 28 12:16:39.007569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 160/333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:39.336561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:39.337174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:39.343636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:39.344118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:39.344831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:39.345535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:39.345989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:39.346419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:39.362860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06ddf050-301b-4138-8e67-8f5f6e662fd5 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306287c940>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:39.392352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06ddf050-301b-4138-8e67-8f5f6e662fd5 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033136 Sep 28 12:16:39.392909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 161/334] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:39 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:39.471995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:39.481077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-edb50c07-908a-4895-8160-0352ce805fe7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.148838 Sep 28 12:16:39.481646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 174/335] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:39 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:40.030110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:40.030778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:40.036872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:40.037356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:40.037790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:40.038488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:40.038944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:40.039367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:40.101471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:40.111032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20272cd3-56ff-4c59-b049-9bda237477e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1261 microversion: 2.1 time: 0.085183 Sep 28 12:16:40.123596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 162/336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:40.405115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56288966-ddb3-40dd-93d8-fbf573c3c3cc tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306275cd30>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:40.434621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-56288966-ddb3-40dd-93d8-fbf573c3c3cc tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033378 Sep 28 12:16:40.435162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 175/337] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:40 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:40.503825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:40.504461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:40.510396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:40.510876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:40.511894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:40.512620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:40.513080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:40.513534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:40.642605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:40.650240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec6d704d-81a1-4cf6-8dd2-135a0163bdf2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.150178 Sep 28 12:16:40.650792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 163/338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:40 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:41.133196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:41.133712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:41.139759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:41.140229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:41.140684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:41.141359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:41.141801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:41.142216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:41.203339 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:41.210947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2ed34130-e452-4b73-833c-5d9149fe38e5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1261 microversion: 2.1 time: 0.081694 Sep 28 12:16:41.211524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 176/339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:41.447407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e9d093b-dd09-4319-8c8b-b8f2d6350ca6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306293c0d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:41.476768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e9d093b-dd09-4319-8c8b-b8f2d6350ca6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033229 Sep 28 12:16:41.477310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 164/340] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:41 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:41.676614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:41.677224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:41.684803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:41.685348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:41.685837 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:41.686546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:41.687227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:41.687889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:41.836451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:41.845265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d0052bd6-3fda-4138-afd7-deaf8e6c0a65 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.172182 Sep 28 12:16:41.845836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 177/341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:41 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:42.234513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:42.235128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:42.241104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:42.241586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:42.242016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:42.242708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:42.243159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:42.243584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:42.307339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:42.315341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32b2e38e-cff2-4bbf-9bbf-daa6984be954 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.084807 Sep 28 12:16:42.315931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 165/342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:42.489619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-21272615-5421-41b8-8ece-4d1372568adb tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30626f2160>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:42.519371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-21272615-5421-41b8-8ece-4d1372568adb tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 288 microversion: 2.1 time: 0.033680 Sep 28 12:16:42.519922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 178/343] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:42 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:42.530854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5170e872-a0dd-4b1d-bc57-7c5972a722ad tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30628a1e50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:42.585545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5170e872-a0dd-4b1d-bc57-7c5972a722ad tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 202 len: 0 microversion: 2.1 time: 0.058373 Sep 28 12:16:42.586220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 166/344] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Sep 28 12:16:42 2022] DELETE /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:16:42.594874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-aab0b6af-2a80-46ee-a525-e1afe9b44fed tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30628301f0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:42.624058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-aab0b6af-2a80-46ee-a525-e1afe9b44fed tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033061 Sep 28 12:16:42.624629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 179/345] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:42 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:42.869569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:42.870341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:42.876712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:42.877199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:42.877642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:42.878344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:42.878801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:42.879230 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:43.004200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:43.013043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3149e030-04fe-4545-b4ec-ea388d1f0753 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.147586 Sep 28 12:16:43.013614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 167/346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:42 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:43.339834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:43.340464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:43.354218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:43.354691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:43.355177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:43.355858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:43.356330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:43.356757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:43.423748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:43.431154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-542a2ac4-feee-4618-99fd-42a96ae468f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.095714 Sep 28 12:16:43.431709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 180/347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:43.636884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df5ea6bd-6848-4690-b08e-b5ea4cd68738 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306293ca60>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:43.666078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df5ea6bd-6848-4690-b08e-b5ea4cd68738 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033057 Sep 28 12:16:43.666616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 168/348] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:43 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:44.045318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:44.045933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:44.051915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:44.052423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:44.052858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:44.053543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:44.054084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:44.054401 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:44.180068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:44.187679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-163254a3-33a8-4477-9b37-48509a7b1ab8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.146773 Sep 28 12:16:44.188236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 181/349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:44 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:44.454880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:44.455488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:44.461447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:44.461928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:44.462363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:44.463053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:44.463505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:44.463927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:44.525991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:44.534184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a0d75af9-7aa8-43c4-953f-3ff2d263dea8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.083207 Sep 28 12:16:44.534739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 169/350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:44.679256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-24c8aca1-714b-408e-b91d-808367a103a1 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30627583a0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:44.708619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-24c8aca1-714b-408e-b91d-808367a103a1 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033114 Sep 28 12:16:44.709171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 182/351] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:44 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:45.210406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:45.211041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:45.217113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:45.217587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:45.218011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:45.218725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:45.219172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:45.219589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:45.344042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:45.352026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-55f4e1e9-0eb5-4eae-a309-2376b9dadedf tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.145505 Sep 28 12:16:45.352627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 170/352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:45 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:45.556883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:45.557488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:45.565226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:45.565951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:45.566720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:45.567537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:45.567991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:45.568450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:45.631451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:45.639177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2c86ad7a-0298-4b26-b449-23e8954a326d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.086109 Sep 28 12:16:45.639739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 183/353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:45.721375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b30c2d7-1bf1-490b-a13e-d0dab3982f0c tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306278ce50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:45.750919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b30c2d7-1bf1-490b-a13e-d0dab3982f0c tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.033571 Sep 28 12:16:45.751642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 171/354] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:45 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:46.376529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:46.377047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:46.383417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:46.383896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:46.384351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:46.385040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:46.385490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:46.385911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:46.513645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:46.521267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-14d65390-1db2-4abe-b859-814c87effcad tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.149066 Sep 28 12:16:46.521828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 184/355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:46 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:46.663474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:46.664011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:46.669985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:46.670464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:46.670896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:46.671579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:46.672028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:46.672480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:46.731551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:46.739001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6bce86e-7276-4741-bc49-8f1c8230ec53 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.079401 Sep 28 12:16:46.739561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 172/356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:16:46.764503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9bdb1851-9f24-466c-a23a-8e92a8893bda tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30626f2550>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:46.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9bdb1851-9f24-466c-a23a-8e92a8893bda tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.034918 Sep 28 12:16:46.795785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 185/357] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:46 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:47.544318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:47.544955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:47.550869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:47.551343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:47.551771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:47.552481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:47.552930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:47.553349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:47.633364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:47.650606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:47.681732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:47.689262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14572e63-9634-41f5-b1e9-4b1457d9183e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.148806 Sep 28 12:16:47.689823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 173/358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:47 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:47.762494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:47.763028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:47.769186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:47.769667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:47.770342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:47.770783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:47.771242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:47.771665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:47.772225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:47.808717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13e76d79-a261-459b-a511-6761fbe5ceee tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306271ee50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:47.838281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:47.847008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7bcbfe9a-1edb-4a89-a50d-b534294f7612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.089544 Sep 28 12:16:47.847579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 186/359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:47.850635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13e76d79-a261-459b-a511-6761fbe5ceee tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.046424 Sep 28 12:16:47.851279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 174/360] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:47 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:16:48.713220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:48.713857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:48.720655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:48.721167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:48.721598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:48.722395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:48.722768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:48.723192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:48.851559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:48.860290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-45477b74-8cc6-4286-9a85-4ec4635888f1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.150896 Sep 28 12:16:48.860891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 187/361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:48 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:48.868724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16c3a899-47ad-430a-8621-11e257755e85 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306271ed30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:48.880214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:48.880874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:48.887558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:48.888037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:48.888502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:48.889197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:48.889648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:48.890067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:48.900355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16c3a899-47ad-430a-8621-11e257755e85 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 200 len: 287 microversion: 2.1 time: 0.038706 Sep 28 12:16:48.900925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 175/362] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:48 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:48.950945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:48.958491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4e4b063e-8817-4510-aebb-3b670cba5448 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1309 microversion: 2.1 time: 0.082166 Sep 28 12:16:48.959044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 188/363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:49.882723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:49.883280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:49.889995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:49.890478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:49.890914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:49.891605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:49.892059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:49.892594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:49.913724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-99ecc664-e0ee-4774-8086-0d886b2a1aa6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f3062761160>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:49.939990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-99ecc664-e0ee-4774-8086-0d886b2a1aa6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] HTTP exception thrown: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-99ecc664-e0ee-4774-8086-0d886b2a1aa6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Request method failure captured: Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 HTTP/1.1 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDsgQE8ubk0dZBX_4pmtvU_L1ww30y37LTWKCscC7wZuwf2Yl0haUmIBdgnKiSyfQlcFZguQHc7IwRsypQDkF6vDaCZhUQCDZ6pkHRimb37H-GaRGpyMI2xWjDkbUfS2OTxzu8uo-IuTrndWXATQUn0iNdluqh_5EgQgb7tra8ZkCMk Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:16:49.943658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b527fca31484a269222cd738b918290", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b527fca31484a269222cd738b918290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: f8a5b345d91e40e4aa5e57a8dbaa9c61 Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '879e2660-7ecf-4e2c-8930-7c33ce3d7e23'} Sep 28 12:16:49.945054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. (HTTP 404) (Request-ID: req-95d42609-b24a-424d-ade5-5b325c2bfb9f) Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.946016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:49.947219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 12:16:49.948260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-99ecc664-e0ee-4774-8086-0d886b2a1aa6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Returning 404 to user: Snapshot 879e2660-7ecf-4e2c-8930-7c33ce3d7e23 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:49.949488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-99ecc664-e0ee-4774-8086-0d886b2a1aa6 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23" status: 404 len: 111 microversion: 2.1 time: 0.035318 Sep 28 12:16:49.950433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 189/364] 10.222.0.26 () {58 vars in 1251 bytes} [Wed Sep 28 12:16:49 2022] GET /compute/v2.1/os-snapshots/879e2660-7ecf-4e2c-8930-7c33ce3d7e23 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:49.954212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f0688fff-b501-477b-8e29-f8f3f9715183 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30627585e0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:50.017945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f0688fff-b501-477b-8e29-f8f3f9715183 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 202 len: 0 microversion: 2.1 time: 0.067402 Sep 28 12:16:50.018512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 190/365] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:16:49 2022] DELETE /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:16:50.023105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:50.023706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:50.030297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:50.030772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:50.031219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:50.031900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:50.032383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:50.032805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:50.037042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:50.045363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81234dd4-38c4-4882-abb0-6ca0910df3e3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1521 microversion: 2.1 time: 0.166555 Sep 28 12:16:50.045925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 176/366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:49 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:50.050540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e359320c-da24-49e5-b853-fbbacffbd29d tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f306271e280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:50.099408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:50.112573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-86181723-00d1-4059-8f6f-c8f09e671dcb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1327 microversion: 2.1 time: 0.091782 Sep 28 12:16:50.113641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 191/367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:50.124823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e359320c-da24-49e5-b853-fbbacffbd29d tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.077567 Sep 28 12:16:50.125643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 177/368] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:50 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:51.068594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:51.069881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:51.082239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.083003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.083659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.096586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.097606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.098261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.103315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:51.137752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:51.143341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:51.158887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.166907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.168208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.169184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.169847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.170487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.274508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:51.284357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ecf75201-8419-40e3-830b-ff26cb99928b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1501 microversion: 2.1 time: 0.219598 Sep 28 12:16:51.285627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 192/369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:51 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:51.290846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a2d1caaf-0834-4549-a538-7fe6241081c4 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f3062751e50>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:51.357629 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:51.362446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a2d1caaf-0834-4549-a538-7fe6241081c4 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.075395 Sep 28 12:16:51.367318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-842d05b9-9617-4fc6-8a37-3a2e7c64e2ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.235861 Sep 28 12:16:51.378803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 178/370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:51.378803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:51.378803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:51.379193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 193/371] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:51 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:51.385213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.385213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.385213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.385213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:51.385685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:51.385685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:51.390016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:51.525783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:51.533989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f7e925f4-11bf-4e79-9710-86c9c1652d2a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1515 microversion: 2.1 time: 0.164969 Sep 28 12:16:51.534555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 179/372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:51 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:52.379505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00443ab6-87f7-4072-a69a-82f0e8263b81 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30626f24c0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:52.393103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:52.393519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:52.399458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:52.400268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:52.400754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:52.403385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:52.403866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:52.404584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:52.441751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00443ab6-87f7-4072-a69a-82f0e8263b81 tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.067188 Sep 28 12:16:52.442316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 194/373] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:52 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:52.548573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:52.556430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71b4aa4c-15c8-4382-a6b4-0f32f6dd4ae8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.167951 Sep 28 12:16:52.556988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 180/374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:53.457051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b24230b7-73e7-40b0-a937-dcffbe5c351e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30626fa670>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:53.509450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b24230b7-73e7-40b0-a937-dcffbe5c351e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 200 len: 344 microversion: 2.1 time: 0.056731 Sep 28 12:16:53.509963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 195/375] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:53 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:16:53.579229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:53.579835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:53.585669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:53.586215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:53.586644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:53.587394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:53.587846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:53.588270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:53.723050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:53.732299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03a60604-d861-496f-9ec5-07fe645e1e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.156763 Sep 28 12:16:53.733208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 181/376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:54.524349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9b5df72c-d844-4caa-9d80-da583bbddc3f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f30626f2e50>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:54.552199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-9b5df72c-d844-4caa-9d80-da583bbddc3f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] HTTP exception thrown: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9b5df72c-d844-4caa-9d80-da583bbddc3f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Request method failure captured: Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f HTTP/1.1 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDsgQE8ubk0dZBX_4pmtvU_L1ww30y37LTWKCscC7wZuwf2Yl0haUmIBdgnKiSyfQlcFZguQHc7IwRsypQDkF6vDaCZhUQCDZ6pkHRimb37H-GaRGpyMI2xWjDkbUfS2OTxzu8uo-IuTrndWXATQUn0iNdluqh_5EgQgb7tra8ZkCMk Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:16:54.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b527fca31484a269222cd738b918290", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b527fca31484a269222cd738b918290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: f8a5b345d91e40e4aa5e57a8dbaa9c61 Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'c13a984b-eb3a-4e2a-9eac-c3380f398e6f'} Sep 28 12:16:54.556172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. (HTTP 404) (Request-ID: req-c6941e14-d7f2-4ab8-b953-a84d4594ef90) Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.557176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:54.559106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:16:54.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9b5df72c-d844-4caa-9d80-da583bbddc3f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Returning 404 to user: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9b5df72c-d844-4caa-9d80-da583bbddc3f tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 404 len: 109 microversion: 2.1 time: 0.036306 Sep 28 12:16:54.561623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 196/377] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:54 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:54.571166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89ee6487-86d7-46bc-8332-2cce03e3935e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f3062a190d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:54.600427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-89ee6487-86d7-46bc-8332-2cce03e3935e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] HTTP exception thrown: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89ee6487-86d7-46bc-8332-2cce03e3935e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Request method failure captured: Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f HTTP/1.1 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDsgQE8ubk0dZBX_4pmtvU_L1ww30y37LTWKCscC7wZuwf2Yl0haUmIBdgnKiSyfQlcFZguQHc7IwRsypQDkF6vDaCZhUQCDZ6pkHRimb37H-GaRGpyMI2xWjDkbUfS2OTxzu8uo-IuTrndWXATQUn0iNdluqh_5EgQgb7tra8ZkCMk Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:16:54.603693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b527fca31484a269222cd738b918290", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b527fca31484a269222cd738b918290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: f8a5b345d91e40e4aa5e57a8dbaa9c61 Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': 'c13a984b-eb3a-4e2a-9eac-c3380f398e6f'} Sep 28 12:16:54.605729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. (HTTP 404) (Request-ID: req-a800a7fd-5674-41e7-a7af-59085551336d) Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.606628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:16:54.608107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:16:54.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89ee6487-86d7-46bc-8332-2cce03e3935e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Returning 404 to user: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89ee6487-86d7-46bc-8332-2cce03e3935e tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 404 len: 109 microversion: 2.1 time: 0.038837 Sep 28 12:16:54.610702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 182/378] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:16:54 2022] DELETE /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:54.616702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20282cf0-9cea-4721-b80b-bd49a7080d5b tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Calling method '.version_select at 0x7f3062751040>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:54.644111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-20282cf0-9cea-4721-b80b-bd49a7080d5b tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] HTTP exception thrown: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20282cf0-9cea-4721-b80b-bd49a7080d5b tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Request method failure captured: Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f HTTP/1.1 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDsgQE8ubk0dZBX_4pmtvU_L1ww30y37LTWKCscC7wZuwf2Yl0haUmIBdgnKiSyfQlcFZguQHc7IwRsypQDkF6vDaCZhUQCDZ6pkHRimb37H-GaRGpyMI2xWjDkbUfS2OTxzu8uo-IuTrndWXATQUn0iNdluqh_5EgQgb7tra8ZkCMk Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:16:54.646061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b527fca31484a269222cd738b918290", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b527fca31484a269222cd738b918290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b527fca31484a269222cd738b918290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 9b527fca31484a269222cd738b918290 Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1777073587 Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: f8a5b345d91e40e4aa5e57a8dbaa9c61 Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1777073587-project Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'c13a984b-eb3a-4e2a-9eac-c3380f398e6f'} Sep 28 12:16:54.647567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. (HTTP 404) (Request-ID: req-a40fcfaf-20de-4e73-a675-3e024bc4ad5c) Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.648543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:16:54.649876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:16:54.651215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20282cf0-9cea-4721-b80b-bd49a7080d5b tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] Returning 404 to user: Volume c13a984b-eb3a-4e2a-9eac-c3380f398e6f could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-20282cf0-9cea-4721-b80b-bd49a7080d5b tempest-VolumesSnapshotsTestJSON-1777073587 tempest-VolumesSnapshotsTestJSON-1777073587-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f" status: 404 len: 109 microversion: 2.1 time: 0.034581 Sep 28 12:16:54.653022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 197/379] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:16:54 2022] GET /compute/v2.1/os-volumes/c13a984b-eb3a-4e2a-9eac-c3380f398e6f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:16:54.755216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:54.756068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:54.767440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:54.768008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:54.768469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:54.769241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:54.769623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:54.770042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:54.915177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:54.924685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2815729c-f195-48e2-a1ff-5faedb08d608 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.173182 Sep 28 12:16:54.925255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 183/380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:55.056940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:16:55.059936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:55.067135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.067617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.068226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:55.069122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.069726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.070305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:55.096195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lazy-loading 'flavor' on Instance uuid 2fb09cfc-7e3e-4928-ab77-6b692cbad71d {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:16:55.221782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-291fefde-2555-41d0-b063-c2c9956dad62 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/action" status: 200 len: 32 microversion: 2.1 time: 0.171865 Sep 28 12:16:55.224460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 198/381] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:16:55 2022] POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 12:16:55.233749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:55.234569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:55.241002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.241710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.242320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:55.243191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.243790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.244383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:55.447128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:55.472552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f18e665e-8b18-41c9-a8ae-fe6e5d9924a3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.233548 Sep 28 12:16:55.472552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 184/382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:55 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:55.948196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:55.953090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:55.959742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.960588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.961549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:55.962471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:55.962924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:55.963588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:56.154633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:56.167451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f620f131-526f-432a-bc5e-f39161944d44 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.223744 Sep 28 12:16:56.168571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 199/383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:56.495023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:56.497338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:56.524347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:56.524839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:56.525327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:56.526299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:56.526961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:56.527541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:56.690842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:56.699176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d0decdc-3437-4586-8622-a48a08faeb72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.216369 Sep 28 12:16:56.699738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 185/384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:56 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:57.192023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:57.193112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:57.195670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=54 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:16:57.202082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:57.202649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:57.203222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:57.203934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:57.204416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:57.204950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:57.383103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:57.394562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-78bcbddc-49ac-4f3b-a0fc-9036f01d4386 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.206829 Sep 28 12:16:57.395529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 200/385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:57.723575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:57.724171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:57.730962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:57.731453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:57.731871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:57.732596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:57.733049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:57.733471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:57.892669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:57.917454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0665412b-1a92-45d2-8499-61014a15cf73 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.197228 Sep 28 12:16:57.922310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 186/386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:57 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:58.418780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:58.419379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:58.426113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:58.426587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:58.427073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:58.427771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:58.428227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:58.428671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:58.601160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:58.610586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ece0f5db-b09a-4b69-bc9c-ffaa2ded042a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.195829 Sep 28 12:16:58.611166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 201/387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:58.944666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:58.945341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:58.951171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:58.951652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:58.952085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:58.952802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:58.953254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:58.953678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:59.087393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:59.095520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d0daa991-3de7-4254-99d4-d8c2addfcd6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.154729 Sep 28 12:16:59.096105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 187/388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:58 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:16:59.634245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:16:59.634849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:16:59.641832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:59.642552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:59.642980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:59.643674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:16:59.644117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:16:59.644742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:16:59.785925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:16:59.793732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f3c58ce7-85d0-4fff-98db-81ec047cbe8e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.163430 Sep 28 12:16:59.794300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 202/389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:16:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:00.119710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:00.120233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:00.127366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:00.128125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:00.128585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:00.129296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:00.129748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:00.130174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:00.259113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:00.267912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28e2e9ce-f714-40d7-a759-e5bd32c67f3a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.152252 Sep 28 12:17:00.268700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 188/390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:00 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:00.818116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:00.819609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:00.826475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:00.826956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:00.827387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:00.828081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:00.828553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:00.829001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:00.982996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:00.990699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d3970c74-bab1-4fe8-a2a7-0bc66f2f2567 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.177194 Sep 28 12:17:00.991619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 203/391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:01.291300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:01.291961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:01.298168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:01.298650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:01.299089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:01.299787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:01.300237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:01.300795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:01.727944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:01.738397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc83ca42-f73c-48c3-b915-32cba07097d0 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.450927 Sep 28 12:17:01.744040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 189/392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:01 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:02.014161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:02.014806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:02.021313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:02.021796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:02.022233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:02.022932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:02.023384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:02.023955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:02.164096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:02.174783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-34d16787-51c5-4312-864d-614409d0e6f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.164614 Sep 28 12:17:02.175761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 204/393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:02.774954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:02.775557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:02.777389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:02.782761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:02.783242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:02.783676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:02.784393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:02.784849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:02.785275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:02.916218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:02.951926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ae5fc48-3233-48ac-9e6a-94d64c12d84c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.180855 Sep 28 12:17:02.959043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 190/394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:02 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:03.200182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:03.200821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:03.207304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:03.207793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:03.208232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:03.208974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:03.209424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:03.209858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:03.356548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:03.364496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1f1e37e8-2a9d-486d-b77c-626ed4d1526f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.168524 Sep 28 12:17:03.365415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 205/395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:03.983015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:03.984342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:03.990855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:03.991334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:03.991762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:03.992608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:03.993111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:03.993540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:04.141020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:04.148628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f96d092-e0ce-4dda-810c-6b10d3469e01 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.169528 Sep 28 12:17:04.149196 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 191/396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:03 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:04.389055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:04.389660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:04.395985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:04.396488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:04.396915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:04.397590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:04.398038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:04.398453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:04.532291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:04.540330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-25c6ce86-4f7e-416a-96ea-1cbad8693774 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.155786 Sep 28 12:17:04.540885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 206/397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:05.172720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:05.173323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:05.179541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:05.180022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:05.180479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:05.181164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:05.181612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:05.182034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:05.308387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:05.315949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4c859f9-ac1c-4b8a-a1e4-484df996a3cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.147073 Sep 28 12:17:05.316545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 192/398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:05 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:05.562891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:05.563496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:05.569624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:05.570094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:05.570522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:05.571196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:05.571643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:05.572060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:05.697260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:05.705594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd2a0a08-521c-4ac6-b615-7b7b7df81827 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.146417 Sep 28 12:17:05.706164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 207/399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:06.338642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:06.339801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:06.345938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:06.346406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:06.346831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:06.347506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:06.347955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:06.348391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:06.477589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:06.486046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d53c6e8e-c50d-4ff4-bab2-6e87a7107874 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.151213 Sep 28 12:17:06.486822 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 193/400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:06 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:06.729172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:06.729745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:06.736139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:06.736653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:06.737089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:06.737776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:06.738231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:06.738657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:06.865706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:06.874059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-27e0c882-dc07-4f61-93f7-e3d28e782750 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.148891 Sep 28 12:17:06.874640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 208/401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:07.512088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:07.512834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:07.519782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:07.520359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:07.521113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:07.522107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:07.522837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:07.523424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:07.657788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:07.665453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-223439a1-84b8-47c8-adcc-af4c8efccd12 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.158990 Sep 28 12:17:07.666023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 194/402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:07 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:07.896065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:07.896696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:07.903941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:07.904441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:07.904871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:07.905549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:07.905991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:07.906408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:08.028816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:08.036296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0aaf92b5-ff13-4a9a-817e-0b4c9221ba94 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.144052 Sep 28 12:17:08.036889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 209/403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:08.689104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:08.689717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:08.695751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:08.696228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:08.696710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:08.697399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:08.697882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:08.698309 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:08.824402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:08.832067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08429883-e9cb-4baa-8045-ff2ba4f583e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.146789 Sep 28 12:17:08.832666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 195/404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:08 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:09.057954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:09.058563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:09.065027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:09.065500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:09.065930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:09.066610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:09.067058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:09.067481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:09.192398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:09.200494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5d42c55b-9a17-4ee0-b0d0-6c3d816a8630 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.146486 Sep 28 12:17:09.201058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 210/405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:09.855945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:09.856598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:09.863584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:09.864086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:09.864570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:09.865437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:09.866056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:09.866504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:10.087527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:10.091910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:10.099596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dc2e532-aa59-403a-b79e-23844745e5b1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.248281 Sep 28 12:17:10.100877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 196/406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:09 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:10.123705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:10.134660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:10.135218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:10.135776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:10.159548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] Creating event network-changed:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:17:10.173891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-7293414f-2119-44ec-ac7a-e9d9364006d3 req-6a5e9a89-4b8e-4747-9807-701db2239fae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046909 Sep 28 12:17:10.174515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 211/407] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:17:10.223391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:10.224150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:10.231680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:10.232244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:10.232718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:10.233410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:10.233859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:10.234282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:10.368720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:10.376531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9781070f-a98b-43e3-8ada-708207b750b1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.157289 Sep 28 12:17:10.377095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 197/408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:11.124881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:11.125583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:11.131846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:11.132348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:11.132793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:11.133483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:11.133939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:11.134364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:11.152903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:11.264780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:11.272481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-99720256-26ba-4a0b-b4aa-f75be58430f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.152398 Sep 28 12:17:11.273048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 212/409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:11 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:11.398856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:11.399442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:11.406163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:11.406637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:11.407124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:11.407814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:11.408259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:11.408897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:11.533474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:11.541048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd632a9d-741d-4237-bdb1-f650497ca0be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.146036 Sep 28 12:17:11.541610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 198/410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:12.295010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:12.295596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:12.302098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:12.302578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:12.303013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:12.303697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:12.304146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:12.304597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:12.428913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:12.437188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eab7ebdc-85af-4827-8041-8bdb609f0b72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.145946 Sep 28 12:17:12.437840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 213/411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:12 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:12.564513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:12.565129 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:12.571273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:12.571750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:12.572186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:12.572901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:12.573358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:12.573783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:12.700476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:12.707919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d7edb8a-453c-4ea7-879a-e08df90c54c8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.147337 Sep 28 12:17:12.708565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 199/412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:13.460726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:13.461337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:13.468252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:13.468759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:13.469191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:13.469877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:13.470584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:13.471213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:13.609534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:13.617110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b4708d26-bd63-4181-90b9-ccd6140a0c72 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.160236 Sep 28 12:17:13.617680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 214/413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:13 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:13.731311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:13.731918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:13.737868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:13.738349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:13.738782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:13.739466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:13.739921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:13.740369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:13.864441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:13.871939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3fdea7c4-036b-4a8a-94fe-34a572749c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.145014 Sep 28 12:17:13.872542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 200/414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:14.640774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:14.641377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:14.647708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:14.648182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:14.648645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:14.649354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:14.649892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:14.650321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:14.775773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:14.783512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-70bdcbb8-64d8-45f4-ab17-cd64f931be2e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.146572 Sep 28 12:17:14.784114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 215/415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:14 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:14.894853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:14.895463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:14.901406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:14.901885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:14.902314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:14.903026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:14.903483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:14.903938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:15.029899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:15.037549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28dd3f2e-d7aa-4166-959d-2442552603be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.146607 Sep 28 12:17:15.038110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 201/416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:15.806676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:15.807870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:15.814283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:15.814791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:15.815227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:15.815910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:15.816386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:15.816814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:15.951546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:15.959160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4ee156dd-689e-4e22-b56e-acfd4386c2da tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.156262 Sep 28 12:17:15.959724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 216/417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:15 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:16.060776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:16.061338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:16.067214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:16.067693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:16.068126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:16.068847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:16.069299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:16.069720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:16.193903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:16.201538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e37a35b8-822b-4cc3-bdf6-be0e41979b68 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.144886 Sep 28 12:17:16.202099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 202/418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:16.983154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:16.983754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:16.990187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:16.990658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:16.991141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:16.991825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:16.992271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:16.992716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:17.121662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:17.129890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-941606c3-7c10-418e-be9c-94724b027819 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.151109 Sep 28 12:17:17.130461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 217/419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:16 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:17.226230 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:17.227057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:17.233999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:17.234480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:17.234906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:17.235608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:17.236062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:17.237056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:17.435849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:17.443472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b7fb0d5-16b0-494d-9611-098800d11a4c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.222152 Sep 28 12:17:17.444043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 203/420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:18.153012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:18.153623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:18.160694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:18.161172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:18.161605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:18.162292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:18.162744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:18.163171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:18.297090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:18.308100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6c11ed11-2496-4f8b-92c4-269046ef639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.155558 Sep 28 12:17:18.308743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 218/421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:18 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:18.466243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:18.466856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:18.473076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:18.473559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:18.473998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:18.474695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:18.475151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:18.475581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:18.603300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:18.611473 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-668bc07a-734e-41b6-b411-2f04722359cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.149019 Sep 28 12:17:18.612038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 204/422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:19.332220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:19.332896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:19.339180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:19.339664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:19.340098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:19.340822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:19.341785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:19.341785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:19.470989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:19.478695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b0d18805-fd53-4143-a630-9195154151bb tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.151018 Sep 28 12:17:19.479841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 219/423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:19 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:19.637244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:19.637847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:19.643831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:19.644328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:19.644778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:19.645462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:19.645993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:19.646412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:19.778606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:19.787231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39afc328-98ef-4a2b-a72b-7153b354bb42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.154239 Sep 28 12:17:19.787750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 205/424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:20.502441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:20.503047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:20.509617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:20.510096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:20.510534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:20.511221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:20.511662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:20.512082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:20.642302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:20.649975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1eccd733-34aa-4891-9790-298bf03600de tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.151337 Sep 28 12:17:20.660356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 220/425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:20 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:20.810193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:20.810910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:20.816949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:20.817426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:20.817856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:20.818544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:20.818997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:20.819422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:20.981313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:20.990066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de25aeee-eb5b-449f-b3b1-e8823ad0d037 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.183717 Sep 28 12:17:20.990637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 206/426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:21.673420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:21.674032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:21.680683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:21.681179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:21.681607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:21.683779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:21.683779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:21.683779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:21.856399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:21.864049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-346820ad-fc91-4f22-ab6d-57376cd0a9f3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.194374 Sep 28 12:17:21.864653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 221/427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:21 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:22.013701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:22.014311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:22.020199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:22.020744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:22.021205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:22.021896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:22.022355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:22.022902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:22.163775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:22.174318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93e6351f-fbad-4dd0-843a-01c53ec3f6b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.164961 Sep 28 12:17:22.188816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 207/428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:22.888653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:22.890956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:22.897855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:22.898511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:22.899119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:22.900006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:22.900668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:22.901120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:23.068534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:23.078218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5b1672c9-ea96-405e-acba-2f45188aa677 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.193186 Sep 28 12:17:23.092988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 222/429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:22 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:23.198222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:23.198834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:23.204624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:23.205109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:23.205541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:23.206266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:23.206885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:23.207474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:23.361096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:23.370658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b40ee709-faf2-4383-af9a-4c562fdcb737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.175722 Sep 28 12:17:23.371351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 208/430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:24.101496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:24.103292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:24.110598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.111284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.112001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.112847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.113296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.113713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.122803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "198494c2-08af-4931-adb7-0684fbc93e14", "device": "/dev/sdb"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:24.125800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:24.132546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.133039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.133469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.134391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.134840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.135300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.306422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:24.315749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0dd9c0b2-58d7-465e-8087-204e12bd371c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.220155 Sep 28 12:17:24.316670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 223/431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:24 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:24.394289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:24.394819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:24.401628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.402183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.402626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.403311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:24.403937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:24.404556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:24.436096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ca18c88-0abb-41f6-bc9c-3a74fda7f5fa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "POST /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318617 Sep 28 12:17:24.436878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 209/432] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 28 12:17:24 2022] POST /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:17:24.610618 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:24.618999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b76a4c12-c1b0-44eb-b762-62600999f6ec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.228767 Sep 28 12:17:24.619600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 224/433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:25.258027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "name": "network-vif-plugged", "status": "completed", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:25.272504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:25.273186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:25.274173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:25.290289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] Creating event network-vif-plugged:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:17:25.298058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-5d06f164-170b-4f60-975a-ebd37d1bbcbc req-dfb08277-6b73-4587-b34a-595470157ffc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049064 Sep 28 12:17:25.298936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 210/434] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:17:25.339242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:25.339859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:25.348232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:25.349923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:25.350679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:25.351073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:25.351530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:25.351957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:25.517001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:25.528576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9176e628-5d9a-4333-b93d-dcd1695116f2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.193356 Sep 28 12:17:25.529634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 225/435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:25 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:25.644156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:25.645074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:25.653071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:25.653754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:25.654357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:25.658438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:25.658438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:25.658438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:25.797603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:25.806144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae5788e9-d037-4745-873e-4ecea220148f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.166189 Sep 28 12:17:25.807195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 211/436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:26.569745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:26.570365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:26.578271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:26.578947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:26.579682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:26.580726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:26.581188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:26.581635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:26.789244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:26.799758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a9c637fa-c24d-4b98-b983-0fef86ffb44f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.249301 Sep 28 12:17:26.800497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 226/437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:26 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:26.829647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:26.830920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:26.837974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:26.839065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:26.839501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:26.840202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:26.840687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:26.841116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:26.983605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:26.987206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:26.992440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-449a2460-e39f-4dc9-8a0c-4bb995223783 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1357 microversion: 2.1 time: 0.166624 Sep 28 12:17:26.993012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 212/438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:27.747255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-282141249", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:27.754559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=54 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:27.801491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] validate_networks() for None {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:17:27.822873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:27.823519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:27.831905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:27.832590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:27.833043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:27.833750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:27.834212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:27.834642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:27.961527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:27.969863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08854f23-ad9b-4e4e-bee8-a98253b361ca tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.150861 Sep 28 12:17:27.971008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 213/439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:27 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:28.015727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.016247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.022069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.022540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.022966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.023648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.024090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.024534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.078007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:17:28.078438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:17:28.078912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:17:28.079321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:17:28.079730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:17:28.088795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.089275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.089712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.090435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.090889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.091313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.108573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Getting quotas for project b3720873acbd42708f9ab86b749dae3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:17:28.112623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Getting quotas for user 6d9e364f2e12418d8d53d8c0dd272b38 and project b3720873acbd42708f9ab86b749dae3d. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:17:28.124294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:17:28.126670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:17:28.154888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:28.162882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b444da3-824c-4e77-ba4c-3ab2d0d17321 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1546 microversion: 2.1 time: 0.151079 Sep 28 12:17:28.163445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 214/440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:28.173621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-75cd777d-ee18-460f-922d-7b6214d9a9a1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431015 Sep 28 12:17:28.174498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 227/441] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:17:28.186616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-723f7409-3509-4120-a36e-3ca33e29591a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.187317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-723f7409-3509-4120-a36e-3ca33e29591a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.190581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.191207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.197413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.197934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.198382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.199057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.199513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.199941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.256083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-723f7409-3509-4120-a36e-3ca33e29591a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:28.266714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-723f7409-3509-4120-a36e-3ca33e29591a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1214 microversion: 2.1 time: 0.085267 Sep 28 12:17:28.267291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 215/442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:28.352208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:28.360120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bde329cb-d0f8-41fa-bb90-8b069c847f2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1546 microversion: 2.1 time: 0.175451 Sep 28 12:17:28.360736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 228/443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:28.376523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-112133874", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "networks": [{"uuid": "01c7a415-788d-41a4-ac86-9f1b8db7a49c"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:28.390817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.396039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:28.398174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Searching by: {'deleted': False, 'project_id': 'e271418048c1466e948bf84de04fc05f'} {{(pid=120636) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 12:17:28.406458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.407087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.407586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.408425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.409023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.409514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.438720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] validate_networks() for [('01c7a415-788d-41a4-ac86-9f1b8db7a49c', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:17:28.513384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.multi_cell_list [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120636) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 12:17:28.565141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:28.618841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0c9d51d3-8388-4a86-ae88-759f747b85de tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.232295 Sep 28 12:17:28.619541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 229/444] 10.222.0.26 () {58 vars in 1125 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:17:28.631484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.632101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.638043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.638527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.638993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.639699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.640153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.640612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.772114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:28.781097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cc095635-8404-4608-ba6c-d023f7860878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1546 microversion: 2.1 time: 0.153430 Sep 28 12:17:28.782210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 230/445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:28.824260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:17:28.824712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:17:28.825193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:17:28.825595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:17:28.826002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:17:28.835854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.836524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.836829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.837630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:28.838088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:28.838546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:28.855606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Getting quotas for project 1d5209c6077a4fd592a983d1430f630b. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:17:28.859604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Getting quotas for user 2b3682aef6f8415f9a5cac2db2f7bff9 and project 1d5209c6077a4fd592a983d1430f630b. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:17:28.871399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:17:28.873724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:17:28.924037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-efa34319-e208-44d5-811c-f42dca8ddc23 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551554 Sep 28 12:17:28.924914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 216/446] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:17:28.937853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6ceb22c2-cef0-4e04-9fbc-5c448dd2bae5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.938463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6ceb22c2-cef0-4e04-9fbc-5c448dd2bae5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.995050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:28.995909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:28.999396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6ceb22c2-cef0-4e04-9fbc-5c448dd2bae5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:29.005178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:29.005865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:29.006774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:29.008208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:29.008550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6ceb22c2-cef0-4e04-9fbc-5c448dd2bae5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1213 microversion: 2.1 time: 0.074658 Sep 28 12:17:29.009305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:29.009579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 231/447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:29.010735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:29.184269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:29.193429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2db4e67-9bf1-4794-a837-8ae022a3da31 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.204176 Sep 28 12:17:29.194120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 217/448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:28 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:29.290358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:29.290921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:29.297498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:29.298146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:29.298658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:29.299423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:29.299992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:29.300447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:29.361771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:29.370260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-369de224-d417-4385-9a1c-372a54fc779d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1218 microversion: 2.1 time: 0.083609 Sep 28 12:17:29.371024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 232/449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:29 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:30.038346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:30.038945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:30.045780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.046256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.046682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.047360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.047805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.048226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.112040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:30.120393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-140a8744-e0e2-4023-897f-aef697135aa2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1217 microversion: 2.1 time: 0.085225 Sep 28 12:17:30.120951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 218/450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:30 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:30.217772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:30.218386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:30.225242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.225405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.225869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.226543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.226983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.227612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.381159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:30.389064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a18d01db-bf92-41d3-929d-b0be33a0483d"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:30.389354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd548ad6-e884-463e-91ee-e5207548257e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.175900 Sep 28 12:17:30.389924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 233/451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:30 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:30.391719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:30.394449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:30.395260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:30.397802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.398517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.399027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.399799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.400340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.401433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.401802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.402351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.402853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.403608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:30.404244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:30.404836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:30.465310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:30.473610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-de4d2534-1fbf-46c4-ad10-938e674b08e1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1218 microversion: 2.1 time: 0.082666 Sep 28 12:17:30.474301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 234/452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:30 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:31.143202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:31.143794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:31.150231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.150763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.151207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.151871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.152489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.152914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.198887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fbe049a1-865b-4aaa-9e45-4ebe34b9bee2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814990 Sep 28 12:17:31.204818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 219/453] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 28 12:17:30 2022] POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:17:31.216656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:31.225729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6d524da6-d8a4-4cab-9782-b4a2c9c29623 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1265 microversion: 2.1 time: 0.087141 Sep 28 12:17:31.232502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 235/454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:31 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:31.413371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:31.414081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:31.420817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.421295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.421725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.422406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.422856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.423277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.500505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:31.501382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:31.509743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.510596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.511366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.512084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:31.512591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:31.513256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:31.601476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:31.610569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-13b10d00-8b6d-4f4e-a85f-599df06dbc92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.201781 Sep 28 12:17:31.611420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 220/455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:31 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:31.613210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:31.621989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7ca16b60-07ce-4422-8d08-39c9c904b4aa tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1210 microversion: 2.1 time: 0.128095 Sep 28 12:17:31.622554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 236/456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:31 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:32.249697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.250639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:32.257560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.258020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.258454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.259352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.259794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.260955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.328140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:32.336112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2da6e312-9749-4094-b0af-eb7690a7bba2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1265 microversion: 2.1 time: 0.090177 Sep 28 12:17:32.336711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 221/457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:32.634358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.635970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:32.643645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.644132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.644718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.644978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:32.645586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.645760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:32.646187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.646610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.652714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.653091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.653525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.654222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:32.654670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:32.655086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:32.722299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:32.729841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f06383fe-a84e-4080-9d2e-e7c05972abc2 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1210 microversion: 2.1 time: 0.088894 Sep 28 12:17:32.730695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 222/458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:32.780949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:32.788542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-68292695-ad28-420c-bfaa-f3171642e377 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.158132 Sep 28 12:17:32.789106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 237/459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:32 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:33.360031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:33.360712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:33.363051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:33.368609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.369090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.369524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.370215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.370670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.371087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.433077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:33.440450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08cced9c-6bf0-4851-9a3b-5bcbf064816b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1265 microversion: 2.1 time: 0.084180 Sep 28 12:17:33.441014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 223/460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:33 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:33.753002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:33.753603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:33.760862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.761350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.761792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.762853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.764172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.764172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.810761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:33.811371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:33.817278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.817766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.818313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.819012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.819471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.819897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.827525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:33.835066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bcbc7615-fbb3-42f0-a6e7-b198acf577af tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1266 microversion: 2.1 time: 0.085991 Sep 28 12:17:33.835641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 238/461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:33 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:33.949291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:33.956891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78b64d43-347f-4204-81dd-95005e533b8d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1501 microversion: 2.1 time: 0.149912 Sep 28 12:17:33.957457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 224/462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:33 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:33.979458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4effbedf-658c-4fec-b4fd-777ae739cc9b"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:33.981978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:33.987961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.988708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.989344 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:33.990381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:33.990847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:33.991277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.021988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] HTTP exception thrown: Cannot 'attach_volume' instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d while it is in vm_state rescued Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Request method failure captured: Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/os-volume_attachments HTTP/1.1 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 74 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDq3F-7RSfY0wBcwVqLJTwtNRwQawEk5rLEv8GXxyN21I6q5cUIq54utvRsdAm71ceCHcZd17rfssu7MPhKxLTLbeTm8bRbrRF6LA52WaetaGgc8JeHNNQUPGz3x-fOl0ZJz7kVDPWUZFGYWJv3YU-yk-0__NeVR-xSnIjp1WTR_Kiw Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:17:34.023900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47157b4286ac4ed5a24ba31bafd206a2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 956c7f92a4a747dba49e3f3a527bba74 Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {"volumeAttachment": {"volumeId": "4effbedf-658c-4fec-b4fd-777ae739cc9b"}} Sep 28 12:17:34.025672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Cannot 'attach_volume' instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d while it is in vm_state rescued Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'server_id': '2fb09cfc-7e3e-4928-ab77-6b692cbad71d', 'body': {'volumeAttachment': {'volumeId': '4effbedf-658c-4fec-b4fd-777ae739cc9b'}}} Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:17:34.026453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d while it is in vm_state rescued Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:17:34.027593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d while it is in vm_state rescued Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Returning 409 to user: Cannot 'attach_volume' instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d while it is in vm_state rescued {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6d60bbdf-e948-4dd2-b87e-d9c5202e2730 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050400 Sep 28 12:17:34.028725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 239/463] 10.222.0.26 () {60 vars in 1323 bytes} [Wed Sep 28 12:17:33 2022] POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 12:17:34.034975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:34.035517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:34.041435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.041914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.042352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.043046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.043499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.043927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.121215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da1f1c55-e97f-478d-b467-9cf6913afc3e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/action" status: 202 len: 0 microversion: 2.1 time: 0.089583 Sep 28 12:17:34.122580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 225/464] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:17:34 2022] POST /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:17:34.131957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:34.132703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:34.139557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.140047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.140793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.141500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.141962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.142386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.326118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:34.335461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-136bf81e-9d5d-4b28-98d9-f61f9269760a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.207245 Sep 28 12:17:34.336078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 240/465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:34 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:34.466641 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:34.467470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:34.477543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.478141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.479211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.480019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.480606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.481130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.563708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:34.572837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79a91404-aab0-459c-aa9d-965a2af43de1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1271 microversion: 2.1 time: 0.113073 Sep 28 12:17:34.573487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 226/466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:34 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:34.859316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:34.859950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:34.866104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.866585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.867022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.867720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:34.868174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:34.872624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:34.965116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:34.975949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-60968c59-0a29-4862-8039-b0f8e602abbd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1266 microversion: 2.1 time: 0.119799 Sep 28 12:17:34.977141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 241/467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:34 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:35.359684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:35.360291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:35.366384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:35.366869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:35.367299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:35.367996 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:35.368482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:35.368960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:35.597085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:35.597632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:35.603667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:35.604825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:35.605251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:35.605937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:35.606379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:35.606794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:35.741575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:35.749361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7068d24f-8b38-4eea-afc4-dcdc279be700 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.156492 Sep 28 12:17:35.750051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 242/468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:35 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:35.850450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:35.858944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-297b83c0-7e19-4c10-b3f5-125c7413ded7 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.503025 Sep 28 12:17:35.864980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 227/469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:35 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:36.005666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:36.006399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:36.013273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.013763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.014197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.014894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.015348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.015770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.078956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:36.086668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4837ae0a-e408-46ed-bff8-035194dbbd7b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1272 microversion: 2.1 time: 0.084962 Sep 28 12:17:36.087248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 243/470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:36 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:36.467801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9bb749a-f713-4221-be36-d74a239ef8b8", "tag": "497eca56-1ae6-49db-9b1b-85590336b395"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:17:36.478384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.479011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.479438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.491643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] Creating event network-changed:497eca56-1ae6-49db-9b1b-85590336b395 for instance f9bb749a-f713-4221-be36-d74a239ef8b8 on hv-cinder-85919 Sep 28 12:17:36.498723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-18b687b3-1934-4ed9-a9ee-c76ca7de3c36 req-b18e0eb0-e115-4b44-a151-58729cbeea47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034597 Sep 28 12:17:36.499317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 228/471] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:17:36.777524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:36.778164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:36.784848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.785353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.785784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.786473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.786923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.787380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.886850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:36.888074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:36.894606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.895096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.895534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.896240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:36.896721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:36.897146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:36.919243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:36.925822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:36.934626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4aa7061b-c4d9-42d4-85cc-d80c8d182213 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.161580 Sep 28 12:17:36.935190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 244/472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:36 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:37.035148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:37.042663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4a4ec23-dc5c-4516-9f46-44fff7fbe432 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.160081 Sep 28 12:17:37.043219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 229/473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:36 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:37.110855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:37.111455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:37.117374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:37.117871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:37.118325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:37.119006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:37.119957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:37.120408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:37.245774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:37.253547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2e7d158e-a774-48dd-8973-f3a8785a81e7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146441 Sep 28 12:17:37.254107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 245/474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:37 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:37.958133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:37.958738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:37.965746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:37.966222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:37.966672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:37.967360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:37.967804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:37.968220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:38.066400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:38.067054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:38.073813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:38.074286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:38.074713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:38.075396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:38.075839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:38.076255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:38.096564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:38.104258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-616bbc56-911a-46f3-a29c-d9522178ecff tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149927 Sep 28 12:17:38.104932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 230/475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:37 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:38.202470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:38.210049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-757c596a-8e28-40d4-a720-fcd25883a251 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.147528 Sep 28 12:17:38.210608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 246/476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:38 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:38.276515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:38.277051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:38.282926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:38.283396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:38.283819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:38.284527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:38.284969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:38.285389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:38.422862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:38.430538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-384b8d3f-d24d-4c25-b98a-abdd83e2bbf4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.158464 Sep 28 12:17:38.431085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 231/477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:38 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:39.126880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:39.127508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:39.129409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.130091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=8 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.136395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.136869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.137296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.137970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.138413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.138831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.156629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.234869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:39.235580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:39.237452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.238218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:39.244534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.245022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.245462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.246223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.246686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.247110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.267229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:39.274702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1c8f1642-2bcb-47fc-96a9-88ced476f3c7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.151609 Sep 28 12:17:39.275264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 247/478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:39 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:39.374616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:39.382922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e95ebeb-6ead-4eab-83a1-fb6bf21b144e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151829 Sep 28 12:17:39.383463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 232/479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:39 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:39.453193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:39.453801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:39.459581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.460055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.460519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.461204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:39.461648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:39.462069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:39.586830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:39.595122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bce5ea2b-6c2d-45aa-af32-692307b6e473 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145657 Sep 28 12:17:39.595958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 248/480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:39 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:40.297850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:40.298460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:40.305105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.305587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.306025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.307370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.307832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.308274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.406020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:40.406629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:40.412974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.413448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.413872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.414557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.415004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.415421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.436757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:40.444377 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b36db03-5577-45f0-9a40-4d0fbb4cdb1b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.150361 Sep 28 12:17:40.445087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 233/481] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:40 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:40.545626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:40.553315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a2073c4b-2e50-49e6-b003-6a827d2bc5e2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151126 Sep 28 12:17:40.553885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 249/482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:40 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:40.617694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:40.618296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:40.624790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.625263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.625687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.626367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:40.626815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:40.627231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:40.752228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:40.759839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf90131e-e480-46f7-874b-fe0ddb74edbc tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145879 Sep 28 12:17:40.760411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 234/483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:40 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:41.467180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:41.467724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:41.474449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.474920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.475347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.476028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.476509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.476933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.577420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:41.578021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:41.584443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.584919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.585354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.586041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.586489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.586910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.602371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:41.609902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b8905c09-c6b1-4537-b64f-13b541446832 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.146572 Sep 28 12:17:41.610471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 250/484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:41 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:41.711251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:41.719049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1c86a17-6b62-4e9a-a3d7-da3f6de7c53f tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.145280 Sep 28 12:17:41.719557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 235/485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:41 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:41.782296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:41.782933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:41.788873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.789356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.789786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.790466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:41.790922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:41.791939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:41.917802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:41.925397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-015fd2a7-05d5-42ae-9400-c24a246ee74f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146972 Sep 28 12:17:41.925964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 251/486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:41 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:42.632846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:42.633454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:42.639893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.640397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.640833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:42.641542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.641995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.642416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:42.742773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:42.743809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:42.752184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.752642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.753062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:42.753798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.754250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.754677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:42.783077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:42.790896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3fdef39-83d9-4a0a-9ee0-3c2ed942ea8d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.161751 Sep 28 12:17:42.791984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 236/487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:42 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:42.885776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:42.893484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f321b18a-4ea8-4e1b-bfdf-6fa6643c6853 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.154584 Sep 28 12:17:42.894064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 252/488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:42 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:42.948802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:42.949417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:42.955345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.955828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.956266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:42.956985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:42.957442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:42.957866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:43.083338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:43.091355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02816fd4-4e1e-4f20-8bb7-895a8d1eea54 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146354 Sep 28 12:17:43.091933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 237/489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:42 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:43.815589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:43.816114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:43.822570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:43.823042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:43.823463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:43.824138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:43.824616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:43.825041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:43.917739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:43.918449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:43.924832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:43.925315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:43.925747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:43.926438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:43.926894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:43.927317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:43.951867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:43.959652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a1ac4d0e-49ea-4d3f-ad73-84d5da0272d5 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.148996 Sep 28 12:17:43.960226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 253/490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:43 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:44.062244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:44.070039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-881e6f0a-9679-46d6-a301-5d7b911886a8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.156587 Sep 28 12:17:44.070538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 238/491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:43 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:44.118042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:44.118651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:44.124616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:44.125094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:44.125525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:44.126205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:44.126656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:44.127078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:44.257717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:44.265858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-39b75014-40c7-4d9a-9e4b-e352a584abe9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.151630 Sep 28 12:17:44.266431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 254/492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:44 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:44.983142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:44.983752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:44.990136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:44.990607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:44.991038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:44.991717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:44.992164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:44.992610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:45.093712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:45.094316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:45.101224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:45.101701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:45.102129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:45.102816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:45.103283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:45.104203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:45.123651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:45.131452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2563258b-2cc0-4cfd-b9ce-e417ba6402a7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.152809 Sep 28 12:17:45.132020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 239/493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:44 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:45.228865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:45.236631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0e2a2d22-d788-4d1a-9c5d-ee2e9b76c4c8 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.146964 Sep 28 12:17:45.237160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 255/494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:45 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:45.289165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:45.289941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:45.295833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:45.296326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:45.296762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:45.297445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:45.297891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:45.298310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:45.422000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:45.429512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-526b7412-c022-4dc3-ba09-e1aa5f397fc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.144469 Sep 28 12:17:45.430067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 240/495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:45 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:46.154333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:46.154934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:46.161259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.161726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.162153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.162831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.163277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.163696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.260329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:46.260952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:46.267210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.267682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.268111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.268832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.269285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.269766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.293016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:46.300696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7bd53c33-4b14-4791-9347-050404798242 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.150560 Sep 28 12:17:46.301268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 256/496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:46 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:46.405138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:46.412756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18b7fced-fdf8-42e2-9f2b-553f94c8b906 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.156698 Sep 28 12:17:46.413333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 241/497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:46 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:46.452579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:46.453196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:46.459108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.459585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.460019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.460742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:46.461199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:46.461625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:46.583318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:46.591439 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f302b8d6-b993-443c-97e6-d4cf4cae3237 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.142648 Sep 28 12:17:46.592007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 257/498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:46 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:47.322844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:47.323431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:47.329790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.330260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.330684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.331371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.331825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.332240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.435071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:47.435794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:47.442360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.442846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.443282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.443975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.444458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.444893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.464909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:47.472885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6a33116-4851-41df-bc0f-c60e3cfca820 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.153903 Sep 28 12:17:47.473454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 242/499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:47 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:47.573251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:47.580754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0ffe1559-f7db-46db-b3ac-52ae2427a218 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.149552 Sep 28 12:17:47.581317 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 258/500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:47 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:47.614170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:47.614774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:47.620583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.621084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.621510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.622190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:47.622637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:47.623055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:47.756576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:47.764590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-632c265e-a5f7-4b2d-b294-0cdfa7bdfd7a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.154158 Sep 28 12:17:47.765147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 243/501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:47 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:48.497385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:48.497996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:48.504398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.504876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.505310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.505990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.506440 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.506870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.604935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:48.605673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:48.612028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.612542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.612971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.613656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.614103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.614520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.634682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:48.642427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-75e9f227-67ad-424c-a353-c4a9eb2305a3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149356 Sep 28 12:17:48.643076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 259/502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:48 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:48.741313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:48.749958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2f1c2b9f-0805-4bdf-9ee0-da560768e90b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.149420 Sep 28 12:17:48.750465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 244/503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:48 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:48.788364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:48.788975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:48.795377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.795802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.796229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.796947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:48.797395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:48.797821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:48.920659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:48.928117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6db00b05-c3bc-4d0b-b000-86b6ccfbe2d6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.143650 Sep 28 12:17:48.928727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 260/504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:48 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:49.665324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:49.665964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:49.672531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.673009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.673443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.674130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.674583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.675005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.773102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:49.773817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:49.780369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.780933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.781436 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.782189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.782667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.783093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.807280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:49.815058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2606bef4-277a-42b1-8fd1-7e72bb3a0f91 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.153530 Sep 28 12:17:49.815636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 245/505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:49 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:49.910325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:49.917926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-50ecb730-d0a6-4a58-bc16-9a99a8f1fa86 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.148673 Sep 28 12:17:49.918489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 261/506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:49 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:49.951255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:49.951885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:49.957814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.958292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.958717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.959393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:49.959837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:49.960257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:49.964720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:50.084533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:50.092611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8828855c-2bea-4e6c-b593-8c9ec68651b3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145803 Sep 28 12:17:50.093174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 246/507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:49 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:50.837330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:50.837922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:50.844456 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:50.844941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:50.845377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:50.846334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:50.846787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:50.847209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:50.941400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:50.942021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:50.948508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:50.949085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:50.949581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:50.950365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:50.950883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:50.951369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:50.971715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:50.979901 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-15d3f415-3d48-4e32-b379-490e8004ba30 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.146245 Sep 28 12:17:50.980554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 262/508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:50 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:51.089366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:51.097250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21399e69-0c7e-44bf-a774-f06a813dd5b2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.159751 Sep 28 12:17:51.097816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 247/509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:50 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:51.114890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:51.115496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:51.122155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:51.122627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:51.123058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:51.123743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:51.124188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:51.124642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:51.451921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:51.459542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f4c11780-b56d-4356-b180-24748003f24f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.348478 Sep 28 12:17:51.460108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 263/510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:51 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:52.004064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:52.004650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:52.011854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.012347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.012784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.013470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.013927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.014350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.121149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:52.121755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:52.128065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.128570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.129000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.129678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.130127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.130543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.134483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:52.142478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:52.149983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b6c3e68-1bea-4b15-91b5-26119682609b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149840 Sep 28 12:17:52.150594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 248/511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:51 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:52.256385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:52.264664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-da8bb268-1c43-493d-852e-6869cf96781e tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.147807 Sep 28 12:17:52.265231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 264/512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:52 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:52.482932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:52.483563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:52.489601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.490075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.490505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.491183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:52.491626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:52.492041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:52.616127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:52.624256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d90d37f8-5511-4583-8885-7ba35eb64d85 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145741 Sep 28 12:17:52.624841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 249/513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:52 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:53.173537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:53.174078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:53.180505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.180989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.181426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.182144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.182595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.183016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.286894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:53.287505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:53.294174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.294536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.294969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.295667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.296117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.296571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.310852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:53.319409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-44360314-fc73-4984-b4d6-3b49b2614fbe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149748 Sep 28 12:17:53.319978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 265/514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:53 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:53.430946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:53.439052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e67bc552-750b-4bd7-98c5-85f58429ea6c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.156017 Sep 28 12:17:53.439618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 250/515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:53 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:53.646615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:53.648495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:53.657762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.660434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.660869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.661556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:53.662001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:53.662416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:53.789610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:53.797397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-530385d7-b93b-4809-9616-9c982303eac7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.154555 Sep 28 12:17:53.798182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 266/516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:53 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:54.341783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:54.342390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:54.348827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.349296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.349723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.350399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.350843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.351256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.462259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:54.462903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:54.469273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.469747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.470176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.471117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.471562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.471982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.477258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:54.484818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01979561-2a76-44ba-9a4f-9e9c29eaf655 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.146862 Sep 28 12:17:54.485598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 251/517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:54 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:54.597721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:54.608022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e1bd449f-7e04-4554-aad8-1e8680ef9f99 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.149370 Sep 28 12:17:54.608689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 267/518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:54 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:54.819930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:54.820565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:54.826568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.827047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.827478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.828166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:54.828645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:54.829070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:54.952918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:54.960450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c5fe712-9373-4dc8-a2af-42fb72abc799 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.144255 Sep 28 12:17:54.961010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 252/519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:54 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:55.507329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:55.507933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:55.514340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.514808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.515235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:55.515916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.516391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.516810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:55.631672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:55.632443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:55.638808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.639279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.639705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:55.640415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.640864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.641278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:55.645329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:55.653380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-db8b5f69-adee-4eb7-86e9-a96a4ab776c8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149886 Sep 28 12:17:55.653949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 268/520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:55 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:55.770544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:55.778626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-caaceddf-a4e2-4da1-8f33-9d0972473285 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151106 Sep 28 12:17:55.779189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 253/521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:55 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:55.983485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:55.984083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:55.985975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:17:55.991547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.992030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.992505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:55.993191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:55.993668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:55.994144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:56.117377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:56.124911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5ab5885a-0678-4c26-8c82-0916bf610990 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145242 Sep 28 12:17:56.125480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 269/522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:55 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:56.677216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:56.677868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:56.684787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:56.685260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:56.685687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:56.686367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:56.686814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:56.687234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:56.802312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:56.802924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:56.809978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:56.810463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:56.810912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:56.811590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:56.812047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:56.812501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:56.812727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:56.820296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5dd39f12-490f-4f0b-9458-998109400975 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.146988 Sep 28 12:17:56.820879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 254/523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:56 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:56.940998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:56.948766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7f334347-f5a4-4848-acdc-420ef82c1fa3 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.150331 Sep 28 12:17:56.949322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 270/524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:56 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:57.146794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:57.147413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:57.153755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.154228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.154652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.155357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.155805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.156220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.284289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:57.292889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b26617be-da7c-4a06-8325-3c346aee616a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.149913 Sep 28 12:17:57.293456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 255/525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:57 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:57.844177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:57.844893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:57.851652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.852136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.852609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.853348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.853803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.854234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.974820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:57.974820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:57.978334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.978894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.979393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.980151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:57.980692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:57.981177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:57.986322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:57.992707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e6527f6c-13ff-4bbb-bb2a-05a5b4dc00a1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.152496 Sep 28 12:17:57.993255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 271/526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:57 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:58.109668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:58.117663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9ee6f78-e473-43d7-8e85-aefb0446a0c2 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.150622 Sep 28 12:17:58.118224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 256/527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:57 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:58.314981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:58.315586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:58.321514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:58.322538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:58.322971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:58.323654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:58.324101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:58.324561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:58.447977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:58.458022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ea21d92f-31dc-401a-90fc-6dc0004b8733 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146888 Sep 28 12:17:58.458591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 272/528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:58 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:59.015336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:59.015878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:59.022243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.022714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.023145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.023855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.024333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.024752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.140664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:59.141271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:59.147652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.148133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.148611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.149304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.149753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.150173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.152422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:59.160011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b386c92-0240-4a84-9969-c585dd7e474e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.148471 Sep 28 12:17:59.160596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 257/529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:59 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:17:59.282904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:59.290550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a7a6fcea-196d-402a-8acd-6e2c069ac23b tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.153692 Sep 28 12:17:59.291129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 273/530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:59 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:17:59.481712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:17:59.482351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:17:59.488267 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.488772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.489201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.489884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:17:59.490330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:17:59.490742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:17:59.615952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:17:59.623904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0bc9bb76-f214-4473-9f80-eae46f2439b7 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146009 Sep 28 12:17:59.624494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 258/531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:17:59 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:00.183075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:00.183597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:00.190070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.190520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.190947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.191618 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.192098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.192539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.314754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:00.315426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:00.317515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:00.321379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.321886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.322324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.323024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.323481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.323905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.325192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a598a7fb-53d9-4491-bb2d-4fb7926809af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.146088 Sep 28 12:18:00.325760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 274/532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:00 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:00.455051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:00.463172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eafa6e54-056c-48c2-859f-c09acbbdf201 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.152638 Sep 28 12:18:00.463738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 259/533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:00 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:00.647509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:00.648225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:00.654671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.655147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.655571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.656260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:00.656725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:00.657143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:00.785258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:00.792805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-612712c8-d7f5-4628-a4dd-818180028da1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.149206 Sep 28 12:18:00.793464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 275/534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:00 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:01.348636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:01.349247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:01.356080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.356581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.357012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.357698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.358149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.358572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.486460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:01.487073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:01.493529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.494589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.495022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.495727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.496203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.496587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.498615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:01.506536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ff743e9-1fe2-4ad5-bcd0-6004d93f98f8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.162042 Sep 28 12:18:01.507106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 260/535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:01 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:01.623112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:01.630637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-47a704fb-88fd-44ac-ad95-6767451b5bdc tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.148009 Sep 28 12:18:01.631202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 276/536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:01 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:01.815575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:01.816131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:01.822038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.822507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.822931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.823606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:01.824052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:01.824498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:01.950020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:01.958212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7fb2a0d-ef52-4ac1-bbae-7b67370db434 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146532 Sep 28 12:18:01.958828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 261/537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:01 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:02.529679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:02.530286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:02.536771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.537241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.537668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:02.538348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.538793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.539209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:02.653488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:02.654078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:02.660437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.660916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.661345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:02.662037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.662485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.662904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:02.666334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:02.673899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d3dd7613-b211-47dc-b413-b10fdc8450e3 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.148277 Sep 28 12:18:02.674488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 277/538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:02 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:02.798716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:02.802063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:02.807601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1408ed9c-c827-4d70-9072-ef9ec0185d1c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.157956 Sep 28 12:18:02.808165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 262/539] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:02 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:02.982285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:02.982892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:02.988881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.989357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.989798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:02.990487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:02.990968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:02.991393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:03.120966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:03.128511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a6838cea-38f3-4187-8a9a-d12b8a9e4c65 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.150711 Sep 28 12:18:03.129071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 278/540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:02 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:03.697779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:03.698447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:03.700681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=80 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:03.705831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:03.706308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:03.706738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:03.707426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:03.707878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:03.708301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:03.829824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:03.830422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:03.831998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:03.836878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:03.837368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:03.838369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:03.839062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:03.839517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:03.839945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:03.840277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08b80c29-111b-4102-8c51-4a587b072fd9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.147038 Sep 28 12:18:03.840845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 263/541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:03 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:03.969198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:03.977982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2b751ef2-5a2d-431c-bbb5-30000ebaeaf6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.152001 Sep 28 12:18:03.979115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 279/542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:03 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:04.151190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:04.151814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:04.157664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:04.158135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:04.158563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:04.159242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:04.159689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:04.160103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:04.286257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:04.294619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9cf72c51-eaf7-44dd-8a5a-f53b22f329de tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.147659 Sep 28 12:18:04.295116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 264/543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:04 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:04.863077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:04.863692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:04.870184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:04.870669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:04.871108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:04.871797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:04.872252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:04.872706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:05.000415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:05.001839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:05.002530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:05.003923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:05.008955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:05.009685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9ae77d31-3767-48b1-ab0a-c6f60078089c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.150045 Sep 28 12:18:05.009968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:05.010265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 280/544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:04 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:05.010408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:05.011105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:05.011557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:05.011981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:05.154361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:05.161932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7361bc8a-11e2-466f-b16d-2c41756c1c92 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.164068 Sep 28 12:18:05.162607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 265/545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:04 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:05.317604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:05.318212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:05.324617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:05.325095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:05.325564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:05.326249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:05.326699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:05.327119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:05.451761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:05.459315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-95ca302b-5363-4580-8e5b-2e1ccec4e195 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.145699 Sep 28 12:18:05.459877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 281/546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:05 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:06.033255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:06.033891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:06.040478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.040965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.041398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.042101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.042555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.042981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.170179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:06.177467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e63f79e4-89f4-4981-ad33-2ba1636916de tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.147977 Sep 28 12:18:06.178017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 266/547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:06 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:06.185393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:06.186009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:06.193935 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.194426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.194867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.195563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.196018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.196493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.326961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:06.334592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1c43c0af-29db-4852-b63f-23fab71e1461 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.153466 Sep 28 12:18:06.335161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 282/548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:06 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:06.482805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:06.483408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:06.489360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.489835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.490265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.490949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:06.491401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:06.491819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:06.619451 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:06.626993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d7957472-39c6-41ba-860e-95c9b7d7d3f3 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.148105 Sep 28 12:18:06.627549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 267/549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:06 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:07.207166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:07.207777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:07.214614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.215096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.215535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.216229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.216693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.217226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.344453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:07.352331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ff96f9f4-1b9e-4a09-afad-8884998b9b5e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149095 Sep 28 12:18:07.352988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 283/550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:07 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:07.357764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:07.358474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:07.364905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.365447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.365959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.366707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.367224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.367709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.493247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:07.501219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6ece3af-f8a4-45c4-bdfa-b313e92d9d47 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.147229 Sep 28 12:18:07.501786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 268/551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:07 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:07.649609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:07.650245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:07.656109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.656629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.657062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.657740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:07.658189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:07.658611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:07.782140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:07.789803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-88903698-004f-4027-a6dd-3d5fb6036ca9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.144027 Sep 28 12:18:07.790372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 284/552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:07 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:08.375265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:08.375899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:08.382203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.382669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.383092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.383767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.384234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.384672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.514374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:08.522020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15473591-0e82-48a1-b0be-c06d696eca72 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.150519 Sep 28 12:18:08.522584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 269/553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:08 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:08.524587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:08.525692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:08.531948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.532454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.532883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.533561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.534006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.534422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.663568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:08.671733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-84d0c6cb-33ed-4a88-a785-85bca24f11cd tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.150907 Sep 28 12:18:08.672329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 285/554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:08 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:08.812227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:08.812858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:08.818773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.819248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.819676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.820383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:08.820833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:08.821249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:08.944880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:08.952907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74475baf-a374-43b2-ac31-b3f72ffe04b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.144496 Sep 28 12:18:08.953470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 270/555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:08 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:09.544685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:09.545293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:09.551845 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.552331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.552771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:09.553447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.553887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.554303 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:09.678841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:09.686476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b131c626-47cd-4e05-abdc-cb0fc9ff6557 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.145655 Sep 28 12:18:09.687041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 286/556] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:09 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:09.694838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:09.695443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:09.702391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.702861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.703291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:09.703969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.704445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.704868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:09.828231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:09.835824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e484a2c-388f-4df6-9488-81dcef91e4ab tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.144810 Sep 28 12:18:09.836430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 271/557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:09 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:09.975175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:09.975801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:09.982992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.983473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.983910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:09.984633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:09.985088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:09.985511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:10.116707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:10.124903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-61c8cde9-cae5-4b2d-ae38-ecaedc7521b8 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.153823 Sep 28 12:18:10.125476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 287/558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:09 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:10.709331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:10.709949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:10.717090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:10.717560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:10.717984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:10.718693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:10.719143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:10.719556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:10.848995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:10.858083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8598cafb-cf7a-4917-a59e-97a153cbc35a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.152222 Sep 28 12:18:10.858558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 272/559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:10 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:10.859862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:10.861075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:10.868182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:10.868741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:10.869169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:10.869936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:10.870385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:10.870804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:10.998251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:11.005984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7fbfbfb4-78d5-4d3b-9a43-a3dd70e79a91 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.149832 Sep 28 12:18:11.006542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 288/560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:10 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:11.147436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:11.148042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:11.153955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:11.154433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:11.154866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:11.155551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:11.156006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:11.156462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:11.282185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:11.289754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c7e9dc8-fee0-4689-8f0e-5abe0b3df600 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146278 Sep 28 12:18:11.290857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 273/561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:11 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:11.879773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:11.880402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:11.887277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:11.887746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:11.888174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:11.888876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:11.889323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:11.889737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:12.017910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:12.026461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-25df5f5b-7a73-4a6f-b923-c3d9a988940f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.150525 Sep 28 12:18:12.027019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 289/562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:11 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:12.029092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:12.029706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:12.036114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:12.036620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:12.037055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:12.037742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:12.038195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:12.038622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:12.164712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:12.172228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15d8cde6-3d1d-43a0-a117-f8aadf12c0d6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.147532 Sep 28 12:18:12.172825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 274/563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:12 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:12.313062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:12.313667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:12.319471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:12.319940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:12.320404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:12.321081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:12.322131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:12.322554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:12.444732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:12.453073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f1bc5144-42cf-40ab-a577-7dfdf923335f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.143785 Sep 28 12:18:12.453637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 290/564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:12 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:13.048736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:13.049332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:13.055601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.056074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.056635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.057319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.057764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.058183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.180471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:13.188002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b4ba380-15e8-4648-b3b9-27adb8681bd4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.143083 Sep 28 12:18:13.188598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 275/565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:13 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:13.196039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:13.196746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:13.203137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.203611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.204043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.204760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.205232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.205639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.330653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:13.338770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4475f690-2e8a-4744-adc8-81801232b5ce tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.146481 Sep 28 12:18:13.339336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 291/566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:13 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:13.475889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:13.476738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:13.484023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.484539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.484991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.485708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:13.486157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:13.486573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:13.611156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:13.619292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d6af768-8d0b-4d7e-9a46-c07a8df34bc6 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146721 Sep 28 12:18:13.619863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 276/567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:13 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:14.210822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:14.211446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:14.218488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.218961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.219383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.220060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.220541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.221215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.351854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:14.360791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a2b74554-4877-4811-a818-0f326498da0f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.153757 Sep 28 12:18:14.361352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 292/568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:14 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:14.362858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:14.363526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:14.370606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.371116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.371549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.372235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.372721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.373147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.502152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:14.510463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20302936-9dda-4eb3-95c1-9442af43cb64 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151662 Sep 28 12:18:14.511022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 277/569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:14 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:14.641734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:14.642336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:14.648691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.649206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.649736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.650431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:14.650969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:14.651397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:14.777372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:14.785011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5d2d28b5-12dc-410c-8c5a-8229437220ec tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146985 Sep 28 12:18:14.785577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 293/570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:14 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:15.385546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:15.388231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:15.397031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.397504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.397932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.398620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.399068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.399488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.527116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:15.533686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:15.534318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:15.534941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c36ae220-b553-4ff7-a453-cedcc4f04610 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.155204 Sep 28 12:18:15.535504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 278/571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:15 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:15.540734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.541212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.541643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.542332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.542779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.543202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.669142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:15.676835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8cd551a5-c21b-48fd-94dc-02f3a4f42c71 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.146934 Sep 28 12:18:15.677402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 294/572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:15 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:15.807961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:15.808610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:15.814436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.814908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.815341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.816023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:15.816514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:15.816939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:15.835877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:15.947629 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:15.955237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e7d3024-6507-4c3a-8017-675aa760ed0f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.151027 Sep 28 12:18:15.955802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 279/573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:15 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:16.556667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:16.557274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:16.559517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:18:16.559667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:18:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 (ip 10.222.0.26) !!! Sep 28 12:18:16.566587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.567066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.567501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:16.568188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.568672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.569097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:16.692669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:16.700070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:16.700739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:16.700871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2a1ce9d7-39b5-4efc-b51f-65c20e31527a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.148015 Sep 28 12:18:16.701391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 295/574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:16 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:16.707387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.707814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.708254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:16.708980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.709436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.709867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:16.839166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:16.847067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd230520-3d8e-45b7-b70a-70ef50832a58 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151556 Sep 28 12:18:16.847634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 280/575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:16 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:16.978744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:16.979310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:16.985273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.985757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.986201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:16.986893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:16.987350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:16.987779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:17.114537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:17.122196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c2b82812-8a15-4f26-bef6-1fb8f588ed6a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.147951 Sep 28 12:18:17.122778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 296/576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:16 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:17.723838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:17.724428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:17.731066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:17.731361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:17.731786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:17.733061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:17.733547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:17.733973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:17.864580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:17.870571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:17.871364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:17.873639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff6d22b5-4d7c-44ec-a2e4-927a6d2838ee tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.154094 Sep 28 12:18:17.874208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 281/577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:17 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:17.878178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:17.878655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:17.879086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:17.879775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:17.880225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:17.880683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:17.898435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:18.010019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:18.017691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ebc27231-de38-4088-ab0d-91762d84285a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.151486 Sep 28 12:18:18.018264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 297/578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:17 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:18.145368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:18.145985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:18.152442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:18.152922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:18.153354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:18.154036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:18.154490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:18.154914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:18.278731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:18.286271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59222724-cff6-4d7e-bbff-f054136efd16 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.144688 Sep 28 12:18:18.286828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 282/579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:18 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:18.895609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:18.896221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:18.902597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:18.903080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:18.903507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:18.904192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:18.904667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:18.905087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:19.031937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:19.039909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ddb6783e-fbc4-4205-b5bd-78512ddac894 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.148112 Sep 28 12:18:19.040533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 298/580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:18 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:19.040672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:19.041403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:19.048498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:19.049083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:19.049581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:19.050343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:19.050867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:19.051360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:19.175589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:19.183756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-934a339e-45d2-4637-bc92-cf96008adb4c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1509 microversion: 2.1 time: 0.147094 Sep 28 12:18:19.184344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 283/581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:19 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:19.310197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:19.310831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:19.316721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:19.317197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:19.317624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:19.318302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:19.318745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:19.319169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:19.460812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:19.469351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d2f3242c-ac14-490a-a29f-f2c1f9e80467 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.163557 Sep 28 12:18:19.470016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 299/582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:19 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:20.061876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:20.062505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:20.068909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.069366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.069850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.070591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.071048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.071973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.086541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30ceba9-f768-401b-b818-6b770cfed43b", "tag": "3898cacd-0b8e-4fc3-8833-d878cac0430d"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:20.097356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.097910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.098402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.110023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] Creating event network-changed:3898cacd-0b8e-4fc3-8833-d878cac0430d for instance d30ceba9-f768-401b-b818-6b770cfed43b on hv-cinder-85919 Sep 28 12:18:20.115033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-e85f2283-0dc5-49eb-9ef9-2208ecb1de36 req-e3768c5d-ef79-4805-a832-b39a64f2f62c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032155 Sep 28 12:18:20.115634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 300/583] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:20.207625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:20.208487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:20.210810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:20.215271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.215755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.216193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.216923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.217384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.217821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.218908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-afdd283e-6aa7-4041-86c5-ae514ba0fb6c tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.160898 Sep 28 12:18:20.219477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 284/584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:20 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:20.343796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:20.351727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0b211056-a485-4ff6-8e22-98d62abd0d8c tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1515 microversion: 2.1 time: 0.148385 Sep 28 12:18:20.352300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 301/585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:20 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:20.495394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:20.496022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:20.502494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.503019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.503614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.504335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:20.504841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:20.505270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:20.651756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:20.660136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e08f41cb-0010-4fd9-b1ee-e2a22bbe86ff tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.170968 Sep 28 12:18:20.660991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 285/586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:20 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:21.242148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:21.242686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:21.249187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:21.249666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:21.250094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:21.250781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:21.251234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:21.251654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:21.402027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:21.409865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c17a0b4b-ded6-4c98-95f3-f6c9ad3feacc tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.171606 Sep 28 12:18:21.410435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 302/587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:21 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:21.685226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:21.686542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:21.693635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:21.694494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:21.695209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:21.697495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:21.698231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:21.698865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:21.923698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:21.933178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e4ac7fd-e3e1-4b22-bf02-3f336dcacf42 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.253671 Sep 28 12:18:21.933932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 286/588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:21 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:22.271878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:22.272528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:22.279946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.280301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.280690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:22.281371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.281822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.282244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:22.416405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:22.424791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d6719cb9-1496-4c3a-86f8-06ccf8655acb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1592 microversion: 2.1 time: 0.156730 Sep 28 12:18:22.425356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 303/589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:22.433867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:22.434472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:22.440691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.441165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.441591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:22.442277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.442722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.443140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:22.642597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:22.654774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6973821b-692d-48ba-811a-5a67f5e68136 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.225250 Sep 28 12:18:22.655829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 287/590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:22 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:22.963509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:22.964775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:22.972552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.973280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.973920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:22.974805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:22.975628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:22.976678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:23.151282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:23.159065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1a239b3a-d720-4045-9dc7-3a07aa56c076 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.205479 Sep 28 12:18:23.159577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 304/591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:22 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:23.680493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:23.682046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:23.689563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:23.690148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:23.690684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:23.691475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:23.691990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:23.692380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:23.833275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:23.841428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c833d7cb-4d2c-43d3-9d5d-be9b495ebe49 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.166232 Sep 28 12:18:23.848988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 288/592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:23 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:24.183308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:24.183912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:24.190307 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:24.190788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:24.191221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:24.191914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:24.192396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:24.192825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:24.400656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:24.408262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c350d01a-bb28-44f7-84ea-9501b0b68495 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.229302 Sep 28 12:18:24.408865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 305/593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:24 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:24.520189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:24.529998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:24.530470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:24.531127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:24.543927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] Creating event network-changed:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:18:24.550181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-f40ae845-9033-4e1d-a24f-fcbad64a36ac req-984a67ec-913d-4b3d-bf9b-3a4f361cc7f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 Sep 28 12:18:24.552499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 289/594] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:24.866287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:24.866896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:24.873529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:24.874021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:24.874741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:24.875524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:24.876149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:24.876597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.031840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:25.042419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c1f6d177-9412-48ae-9386-3faaa60c094f tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.179967 Sep 28 12:18:25.066105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 306/595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:24 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:25.432603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:25.433451 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:25.440204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.440797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.441243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.442098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.442580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.443003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.465110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1215285221"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:25.465541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:25.473137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.473623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.474053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.475157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.475668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.476111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.588922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:25.597433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-295200dc-5b76-41c0-a03c-733f722178c9 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.169972 Sep 28 12:18:25.604699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 290/596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:25 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:25.616647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.network.security_group_api [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Adding security group 6a4e8423-1d23-44ff-b79e-a8213a845e7c to port 22f54f6e-b865-438e-b88a-a3184afa088a Sep 28 12:18:25.958613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3e689b4c-fb5f-4e6d-b465-503686af4e23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action" status: 202 len: 0 microversion: 2.1 time: 0.497623 Sep 28 12:18:25.958613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 307/597] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:18:25 2022] POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:18:25.967436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:25.968302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:25.975442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.976188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.976885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:25.978409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:25.979289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:25.980118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.066521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:26.067145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:26.070189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=78 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:26.075166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:26.075661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:26.076238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.077156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:26.077616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:26.078048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.134347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:26.144566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb58a601-847a-4a3d-8c61-fe9aa1149cb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1639 microversion: 2.1 time: 0.181549 Sep 28 12:18:26.146089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 291/598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1639 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:26.213019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:26.220689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f3d3285e-bc38-4bfe-9cca-81936a4a695b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.158106 Sep 28 12:18:26.221667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 308/599] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:26 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:18:26.567126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:26.577466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:26.577937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:26.578369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.589212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] Creating event network-changed:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:18:26.593799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4e45ac59-f3bf-4bb8-b430-c902c48f2116 req-358d2a65-22f2-4046-8d25-d9d15542038d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030309 Sep 28 12:18:26.594364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 292/600] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:26.620838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:26.621452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:26.627872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:26.628446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:26.628885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.629577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:26.630030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:26.630456 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:26.760646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:26.768260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ef8c73f3-979b-4ee7-8808-3ec41fc3512b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.151770 Sep 28 12:18:26.768855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 309/601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:26 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:27.244738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:27.245435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:27.251486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:27.251961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:27.252415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:27.253100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:27.253555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:27.253981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:27.381908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:27.389555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b72a5d8-29ec-401b-ac2a-3ebfcfefd8d0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149114 Sep 28 12:18:27.390126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 293/602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:27 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:27.791750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:27.792276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:27.798690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:27.799164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:27.799591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:27.800268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:27.800741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:27.801161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:27.928252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:27.936356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ceeb80a1-4ffc-445d-8f4c-4f45a4f58898 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.148992 Sep 28 12:18:27.937044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 310/603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:27 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:28.413075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:28.413603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:28.420040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:28.420561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:28.420991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:28.421667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:28.422116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:28.422535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:28.555085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:28.562734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-15f0dca6-d472-485e-8de8-0da2733d9001 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.153550 Sep 28 12:18:28.563293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 294/604] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:28 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:28.958792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:28.959402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:28.966771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:28.967246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:28.967672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:28.968462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:28.968914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:28.969331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:29.093980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:29.101710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1959b190-fb81-4069-aaf3-ddfe62a2ff2b tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.146718 Sep 28 12:18:29.102271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 311/605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:28 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:29.587476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:29.588088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:29.594555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:29.595035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:29.595469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:29.596458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:29.596914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:29.597340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:29.724273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:29.732557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-351e0df9-64a0-4236-8b76-6f684ad6ecbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.149314 Sep 28 12:18:29.733476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 295/606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:29 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:29.852661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bb749a-f713-4221-be36-d74a239ef8b8", "name": "network-vif-plugged", "status": "completed", "tag": "497eca56-1ae6-49db-9b1b-85590336b395"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:29.863168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:29.863608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:29.864448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:29.877299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] Creating event network-vif-plugged:497eca56-1ae6-49db-9b1b-85590336b395 for instance f9bb749a-f713-4221-be36-d74a239ef8b8 on hv-cinder-85919 Sep 28 12:18:29.883534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-a90e4806-1577-4d3a-84e0-9bc9ffa6bab5 req-b2a6c85b-f9a5-4781-982a-52a68919341c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034150 Sep 28 12:18:29.884900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 312/607] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:30.125301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:30.125850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:30.131823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:30.132325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:30.132763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:30.133446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:30.134511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:30.134933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:30.263867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:30.271388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64c1f665-8257-4a94-894a-4f2398d3e81d tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.149960 Sep 28 12:18:30.271947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 296/608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:30 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:30.756253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:30.757097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:30.763967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:30.764482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:30.764947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:30.765645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:30.766097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:30.766523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:30.897838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:30.906050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5200f79d-fb8b-4760-abc1-4b38e3a8eee0 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.154290 Sep 28 12:18:30.906621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 313/609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:30 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:31.295614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:31.296639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:31.306955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:31.320245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:31.320393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:31.321760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:31.322237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:31.322668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:31.345229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:31.500824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:31.509009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c6672d9a-c839-4015-9b7d-01a150dd5c2e tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.218023 Sep 28 12:18:31.509578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 297/610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:31 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:31.929319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:31.929931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:31.936985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:31.937467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:31.937901 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:31.938589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:31.939038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:31.939459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:32.066891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:32.079911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-245f4df2-bf58-42f5-b923-36dc77c42188 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.154382 Sep 28 12:18:32.080741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 314/611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:31 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:32.531415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:32.532026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:32.538632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:32.539109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:32.539542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:32.540228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:32.540703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:32.541127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:32.667092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:32.674638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-135e7723-bf29-403d-bea0-ee4a1fa19fda tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.147114 Sep 28 12:18:32.675208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 298/612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:32 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:33.103742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:33.104288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:33.110750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:33.111222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:33.111648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:33.112387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:33.112836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:33.113254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:33.244509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:33.248024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:33.253212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1df28b75-6dd6-4f6c-af4c-532a98845ed9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1313 microversion: 2.1 time: 0.154117 Sep 28 12:18:33.253790 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 315/613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:33 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:33.697732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:33.698338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:33.704623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:33.705106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:33.705534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:33.706223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:33.706675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:33.707096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:33.842242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:33.850382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a10504a1-b305-4eb6-9c26-0c28c58302d5 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.156540 Sep 28 12:18:33.850983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 299/614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:33 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:34.276483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:34.277068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:34.283237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:34.283706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:34.284131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:34.284835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:34.285279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:34.285701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:34.413128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:34.421509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cb05d020-4340-408f-8f5d-33b271fafaf1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1496 microversion: 2.1 time: 0.149260 Sep 28 12:18:34.423693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 316/615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:34 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:34.873861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:34.874406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:34.876689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=74 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:34.881845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:34.882253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:34.882686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:34.883364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:34.883813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:34.884260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:35.017547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:35.026139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56ab0b49-477d-4e9c-89b9-1ae1990e6d0a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.155643 Sep 28 12:18:35.026801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 300/616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:34 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:35.934386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30ceba9-f768-401b-b818-6b770cfed43b", "name": "network-vif-plugged", "status": "completed", "tag": "3898cacd-0b8e-4fc3-8833-d878cac0430d"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:35.944605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:35.945101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:35.945520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:35.956541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] Creating event network-vif-plugged:3898cacd-0b8e-4fc3-8833-d878cac0430d for instance d30ceba9-f768-401b-b818-6b770cfed43b on hv-cinder-85919 Sep 28 12:18:35.961361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-c2c4978f-77f0-4428-9704-00124aca1210 req-1fd58af6-d90b-403b-899c-feed2f785679 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031544 Sep 28 12:18:35.961936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 317/617] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:36.050075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:36.050685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:36.057812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:36.058289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:36.058894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:36.059851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:36.060299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:36.061024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:36.246653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:36.254121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3023411-666c-414a-9125-40912722b2bd tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.208764 Sep 28 12:18:36.254677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 301/618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:36 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:37.277535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:37.278233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:37.284445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:37.284926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:37.285368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:37.286054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:37.286504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:37.286930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:37.418655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:37.426288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6ccbbab5-fdf7-407e-86a8-8db39f38b920 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.153499 Sep 28 12:18:37.426858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 318/619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:37 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:38.450371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:38.450977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:38.457358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:38.457831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:38.458261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:38.458941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:38.459421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:38.459836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:38.586567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:38.594506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e916f5f4-d126-4448-9517-3cd010620d47 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1314 microversion: 2.1 time: 0.148600 Sep 28 12:18:38.595073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 302/620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:38 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:39.617073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:39.617678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:39.624045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.624553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.624981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:39.625665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.626117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.626531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:39.770276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:39.778539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-824ce3a5-ccb4-4b7e-b18c-5eaca55760d1 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1463 microversion: 2.1 time: 0.165336 Sep 28 12:18:39.779116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 319/621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:39 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:39.824371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:39.824855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:39.831217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.831695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.832124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:39.832834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.833281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.833701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:39.858954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:18:39.942039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-be023319-55ef-41f6-a169-f99176c7c928 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 204 len: 0 microversion: 2.1 time: 0.121617 Sep 28 12:18:39.942717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 303/622] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:18:39 2022] DELETE /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:18:39.951580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:39.952178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:39.958106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.958576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.959006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:39.959678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:39.960140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:39.960572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:40.086241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:40.094337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-58746db1-3e2a-4e69-819b-1d5ef0270b98 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1469 microversion: 2.1 time: 0.147158 Sep 28 12:18:40.094920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 320/623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:39 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:41.120119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:41.120840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:41.127182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:41.127659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:41.128088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:41.128805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:41.129257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:41.129678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:41.264710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:41.272299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27e586db-1631-403e-8663-871b70a6d5c4 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1469 microversion: 2.1 time: 0.156403 Sep 28 12:18:41.272871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 304/624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:41 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:42.295098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:42.295838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:42.302577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:42.303128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:42.303630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:42.304428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:42.304881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:42.305308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:42.436468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:42.445294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-46748ab1-6100-474f-8dca-6db709eca79a tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1469 microversion: 2.1 time: 0.153968 Sep 28 12:18:42.446387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 321/625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:42 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:42.588554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30ceba9-f768-401b-b818-6b770cfed43b", "name": "network-vif-deleted", "tag": "3898cacd-0b8e-4fc3-8833-d878cac0430d"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:18:42.614596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:42.615080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:42.615637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:42.630702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] Creating event network-vif-deleted:3898cacd-0b8e-4fc3-8833-d878cac0430d for instance d30ceba9-f768-401b-b818-6b770cfed43b on hv-cinder-85919 Sep 28 12:18:42.636593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1c30b520-2f26-4d7d-af48-b14a4a75eefa req-6d07f095-cd12-4b8d-8e42-ce6c1f4948c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051309 Sep 28 12:18:42.637888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 305/626] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:18:43.469355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:43.469981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:43.476789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:43.477265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:43.477696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:43.478391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:43.478822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:43.479236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:43.511748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:43.512150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:43.512590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:43.513022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lazy-loading 'fault' on Instance uuid d30ceba9-f768-401b-b818-6b770cfed43b {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:18:43.555536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d9e364f2e12418d8d53d8c0dd272b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3720873acbd42708f9ab86b749dae3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:18:43.562945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0fea0385-f321-4c05-95eb-1e5b70e6a761 tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 200 len: 1304 microversion: 2.1 time: 0.097481 Sep 28 12:18:43.563501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 322/627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:43 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:18:44.589860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:44.590527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] [instance: d30ceba9-f768-401b-b818-6b770cfed43b] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:44.597131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:44.597601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:44.598024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:44.598706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:44.599148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:44.599565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:44.613286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] HTTP exception thrown: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Request method failure captured: Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b HTTP/1.1 Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDtWufXXjCDO5RDmnOGP4qV0fbGZ5El8dY8PTYJTxj-Vd11tgEV7slvMVUP_daBjXwglJDL73AC0OUMmTjZsnjwP_u5fzuqT3Cnu39P7zJuI_5oVJgWeQUYTOOcPAKzuD72qwQ_7zPEGlIaJBQ3mkviHpWQ9Z_oMLldKB8CbHczPgBs Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: b3720873acbd42708f9ab86b749dae3d Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesNegativeTest-706074271 Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:18:44.614868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3720873acbd42708f9ab86b749dae3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3720873acbd42708f9ab86b749dae3d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3720873acbd42708f9ab86b749dae3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3720873acbd42708f9ab86b749dae3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesNegativeTest-706074271 Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: b3720873acbd42708f9ab86b749dae3d Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesNegativeTest-706074271 Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesNegativeTest-706074271-project Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 6d9e364f2e12418d8d53d8c0dd272b38 Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesNegativeTest-706074271-project Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. Sep 28 12:18:44.616500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd30ceba9-f768-401b-b818-6b770cfed43b'} Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:18:44.617409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. Sep 28 12:18:44.618855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:18:44.620362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] Returning 404 to user: Instance d30ceba9-f768-401b-b818-6b770cfed43b could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:18:44.620362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-462954bb-7d2a-4fd8-90fe-bf17850cd46f tempest-VolumesNegativeTest-706074271 tempest-VolumesNegativeTest-706074271-project] 10.222.0.26 "GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b" status: 404 len: 111 microversion: 2.1 time: 0.031983 Sep 28 12:18:44.620362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 306/628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:18:44 2022] GET /compute/v2.1/servers/d30ceba9-f768-401b-b818-6b770cfed43b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:18:47.687117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:47.687705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:47.694100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:47.694575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:47.695009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:47.695685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:47.696130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:47.696577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:47.719770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e15ab8d0-d45d-400f-934b-61f6077cad3b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee/ips" status: 200 len: 152 microversion: 2.20 time: 0.037199 Sep 28 12:18:47.720333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 323/629] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Sep 28 12:18:47 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:18:56.707056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:18:56.707586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:18:56.709853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:56.710581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:18:56.718097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:56.718574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:56.719030 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:56.719716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:18:56.720158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:18:56.720605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:18:56.746619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aef75250-a16a-4320-a8f6-d5397186eb20 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27/ips" status: 200 len: 145 microversion: 2.1 time: 0.043726 Sep 28 12:18:56.747853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 307/630] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:18:56 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:19:01.478560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:01.479061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:01.482147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=33 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:01.482913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=44 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:01.489108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:01.489598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:01.490037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:01.490739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:01.491870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:01.492331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:01.516213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0938a609-afaa-46a4-87ee-a902c7531c52 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9/ips" status: 200 len: 149 microversion: 2.1 time: 0.041593 Sep 28 12:19:01.516813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 324/631] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:19:01 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:19:34.733338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:34.733917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:34.735853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:34.736554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:34.743036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:34.743521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:34.743964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:34.744691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:34.745178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:34.745608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:34.773464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:19:34.854785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d373dd9d-237f-4801-8992-e718f2a6c246 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 204 len: 0 microversion: 2.1 time: 0.126977 Sep 28 12:19:34.856017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 308/632] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:19:34 2022] DELETE /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:19:34.865211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:34.866026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:34.868400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:34.869053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:34.877766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:34.878368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:34.878685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:34.879388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:34.879842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:34.880265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:35.007437 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:35.015620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-14a68ac0-c1da-4008-ad75-1501b965bc35 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1502 microversion: 2.1 time: 0.155069 Sep 28 12:19:35.016185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 325/633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:34 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:36.039401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:36.040093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:36.047180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:36.047663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:36.048096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:36.048830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:36.049283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:36.049706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:36.179367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:36.187013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03a1cf29-97e9-451a-9b3c-86b9a364278a tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1502 microversion: 2.1 time: 0.151834 Sep 28 12:19:36.187578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 309/634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:36 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:37.129686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bb749a-f713-4221-be36-d74a239ef8b8", "name": "network-vif-deleted", "tag": "497eca56-1ae6-49db-9b1b-85590336b395"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:37.142820 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.143290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.143727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.159280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] Creating event network-vif-deleted:497eca56-1ae6-49db-9b1b-85590336b395 for instance f9bb749a-f713-4221-be36-d74a239ef8b8 on hv-cinder-85919 Sep 28 12:19:37.164392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-dd8ba05d-9ae8-45f5-84dd-488a41ae768b req-5b4b0011-3b8b-4420-911a-eda795464637 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038889 Sep 28 12:19:37.164979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 326/635] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:19:37.211576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:37.212540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:37.220055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.220558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.221010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.221683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.222386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.222806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.257314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.257790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.258221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.258661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lazy-loading 'fault' on Instance uuid f9bb749a-f713-4221-be36-d74a239ef8b8 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:19:37.303935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:37.312632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65d065e8-f5f4-403b-abeb-d6db911af581 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 200 len: 1303 microversion: 2.1 time: 0.105683 Sep 28 12:19:37.313216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 310/636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:37 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:37.508681 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:37.511000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:37.517182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.517665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.518100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.518786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.519238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.519671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.589996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a207f04-f9cb-4231-ab56-95b64e80bad6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action" status: 202 len: 0 microversion: 2.1 time: 0.085078 Sep 28 12:19:37.593455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 327/637] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:19:37 2022] POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:19:37.598678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:37.599311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:37.605822 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.606301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.606736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.607431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:37.607893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:37.608343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:37.758080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:37.767764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e90c4b9e-233d-44c0-8e29-9a3e5ba320e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1750 microversion: 2.1 time: 0.172876 Sep 28 12:19:37.769330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 311/638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:38.335504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:38.336235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f9bb749a-f713-4221-be36-d74a239ef8b8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:38.343296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:38.343772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:38.344203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:38.344912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:38.345361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:38.345781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:38.359336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] HTTP exception thrown: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Request method failure captured: Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 HTTP/1.1 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDtWgXn9keFFVsdcphUlxm20iG2N2wGmLBM9x53MrHobXbvdrfaKwBSq1x1iJNtLtvxhD2cCOfFXMXeYiVJ3L6BOAoEOW9Ip91eElGvXiGJKexOsKC6hATxEvpRLBfUVXbrKf64gS6UN0nd-YigvP-uvl0PyDkrHaO0i7LjfgAYoCQ8 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 1d5209c6077a4fd592a983d1430f630b Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:19:38.361045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d5209c6077a4fd592a983d1430f630b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 1d5209c6077a4fd592a983d1430f630b Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesActionsTest-2094945513-project Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 2b3682aef6f8415f9a5cac2db2f7bff9 Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesActionsTest-2094945513-project Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. Sep 28 12:19:38.362598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'f9bb749a-f713-4221-be36-d74a239ef8b8'} Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:19:38.363518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. Sep 28 12:19:38.365082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:38.366384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Returning 404 to user: Instance f9bb749a-f713-4221-be36-d74a239ef8b8 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:19:38.366384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2fcb4812-21d0-4207-ac75-8ac820a7af05 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8" status: 404 len: 111 microversion: 2.1 time: 0.031146 Sep 28 12:19:38.366384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 328/639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:38 2022] GET /compute/v2.1/servers/f9bb749a-f713-4221-be36-d74a239ef8b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:19:38.431212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1813276149", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "networks": [{"uuid": "01c7a415-788d-41a4-ac86-9f1b8db7a49c"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:38.487251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] validate_networks() for [('01c7a415-788d-41a4-ac86-9f1b8db7a49c', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:19:38.792948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:38.793756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:38.799890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:38.800513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:38.801010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:38.801704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:38.802148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:38.802566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:38.962847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:38.971329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-20ddab1d-e1bc-4ecf-be29-c7830c4c7923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.182934 Sep 28 12:19:38.972330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 329/640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:39.091689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:19:39.092234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:19:39.092619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:19:39.093023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:19:39.093426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:19:39.102490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:39.102960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:39.103387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:39.104093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:39.104566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:39.105537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:39.121932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Getting quotas for project 1d5209c6077a4fd592a983d1430f630b. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:19:39.125834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Getting quotas for user 2b3682aef6f8415f9a5cac2db2f7bff9 and project 1d5209c6077a4fd592a983d1430f630b. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:19:39.136607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:19:39.139187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:19:39.186216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d9a7456-e2ad-452f-97ab-7a6ea6b07edf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758743 Sep 28 12:19:39.186865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 312/641] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:19:39.197715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0562561a-9a3a-41f9-9ec9-452d7ce8c7d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:39.198331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0562561a-9a3a-41f9-9ec9-452d7ce8c7d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:39.251305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0562561a-9a3a-41f9-9ec9-452d7ce8c7d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:39.258408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0562561a-9a3a-41f9-9ec9-452d7ce8c7d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1214 microversion: 2.1 time: 0.064554 Sep 28 12:19:39.258974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 330/642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:39 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:39.995204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:39.995813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:40.002473 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:40.002966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:40.003400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:40.004874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:40.005329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:40.005772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:40.152355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:40.161011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67c83444-caaf-4d55-9195-4d5ab248627a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.170103 Sep 28 12:19:40.161602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 313/643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:40.280173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:40.280816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:40.287769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:40.288250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:40.288727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:40.289418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:40.289868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:40.290292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:40.354904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:40.362947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c561cfac-1328-440a-91a7-7d709c3e268e tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1266 microversion: 2.1 time: 0.086613 Sep 28 12:19:40.363524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 331/644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:40 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:41.185910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:41.186658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:41.193407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:41.194108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:41.194541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:41.195409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:41.196032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:41.196495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:41.385852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:41.386544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:41.393695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:41.394186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:41.394624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:41.395360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:41.396002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:41.396467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:41.421930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:41.430898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1500d4b6-e151-4bc2-8e22-530fe13be354 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.249088 Sep 28 12:19:41.431589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 314/645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:41.550470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:41.558857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b8db56d-4f50-4eba-b0a4-8bbfb5cf6fbf tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.176788 Sep 28 12:19:41.566203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 332/646] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:41 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:41.745663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fc512e-490e-4baf-98e1-de0f1d279809", "tag": "02fb5b91-4965-4806-b72a-455fdfa502fa"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:41.756579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:41.757150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:41.757654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:41.775763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] Creating event network-changed:02fb5b91-4965-4806-b72a-455fdfa502fa for instance f0fc512e-490e-4baf-98e1-de0f1d279809 on hv-cinder-85919 Sep 28 12:19:41.780788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-db84e3f2-0396-4fab-93c7-0a29f998a91f req-dab48dce-0a53-4801-9586-d3165f9b5f60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038751 Sep 28 12:19:41.781776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 315/647] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:19:42.455093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:42.455609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:42.462212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:42.462692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:42.463128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:42.463809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:42.464258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:42.464705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:42.582346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:42.583138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:42.589183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:42.589665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:42.590627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:42.591317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:42.591771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:42.592196 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:42.604238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:42.612975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-12043f6b-630b-42f2-8071-28f3abb67770 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.161866 Sep 28 12:19:42.613536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 333/648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:42.728687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:42.736796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d4af157-6b72-40b8-af9f-e3123733336d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.159156 Sep 28 12:19:42.737353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 316/649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:42 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:43.635572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:43.636169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:43.642583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:43.643048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:43.643472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:43.644145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:43.644617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:43.645038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:43.759113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:43.759761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:43.766407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:43.766887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:43.767339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:43.768031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:43.768515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:43.768937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:43.787067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:43.795922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1ed04ead-c319-4837-b04a-fbd7ba490e86 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.164147 Sep 28 12:19:43.796549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 334/650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:43.895333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:43.903362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41a1c26b-4b2c-4394-ac9b-dde0ff2c7ef9 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.148118 Sep 28 12:19:43.903915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 317/651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:43 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:44.818898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:44.819504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:44.826757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:44.827236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:44.827667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:44.828361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:44.828808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:44.829225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:44.926866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:44.928249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:44.936042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:44.936550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:44.937214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:44.938121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:44.938568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:44.939297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:44.971120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:44.981723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-df19e70b-a18d-4d21-ab61-2ff87ec20967 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.166601 Sep 28 12:19:44.982489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 335/652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:45.166224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:45.174626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a159646c-10e6-4f7a-aa07-428ff285c9e8 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.251665 Sep 28 12:19:45.175413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 318/653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:44 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:46.007002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:46.007590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:46.014646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:46.015118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:46.015576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:46.016253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:46.016721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:46.017141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:46.168964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:46.177282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-06eda905-1d37-4ee6-912b-2d474118176c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.174155 Sep 28 12:19:46.178310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 336/654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:46.197849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:46.198457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:46.205188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:46.205671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:46.206098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:46.206837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:46.207222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:46.207642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:46.351915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:46.360222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2d87f56-2797-4c40-9a30-689e6d601a6b tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.166182 Sep 28 12:19:46.375396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 319/655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:46 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:47.202496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:47.203103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:47.209414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:47.209885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:47.210313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:47.211113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:47.211430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:47.211847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:47.359616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:47.367900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4620af4a-d865-4bef-8344-8f3af91f7497 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.169974 Sep 28 12:19:47.368481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 337/656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:47.382961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:47.383569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:47.390125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:47.390544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:47.390981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:47.391667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:47.392122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:47.392562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:47.520959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:47.528588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed035cdd-b4aa-4b6b-a5ae-79117d0379af tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.149460 Sep 28 12:19:47.529133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 320/657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:47 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:48.262976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc512e-490e-4baf-98e1-de0f1d279809", "name": "network-vif-plugged", "status": "completed", "tag": "02fb5b91-4965-4806-b72a-455fdfa502fa"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:48.283749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:48.284504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:48.285032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:48.297560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] Creating event network-vif-plugged:02fb5b91-4965-4806-b72a-455fdfa502fa for instance f0fc512e-490e-4baf-98e1-de0f1d279809 on hv-cinder-85919 Sep 28 12:19:48.303249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-775a15a0-086b-4f47-bd65-090393b98045 req-a997bcf7-204b-4516-b129-364c45cdbfac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045523 Sep 28 12:19:48.304096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 338/658] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:19:48.392297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:48.392925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:48.399782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:48.400513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:48.401192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:48.401885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:48.403189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:48.404048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:48.565557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:48.565557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:48.576439 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:48.577373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:48.579803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:48.580874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:48.581310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:48.582205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:48.695608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:48.705573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-701148e4-d635-4f6a-9030-bcc9759d23c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.317027 Sep 28 12:19:48.706245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 321/659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:48.729700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:48.737576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-406b86d6-21ec-4361-b0ea-0032b9b4512d tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.190394 Sep 28 12:19:48.738233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 339/660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:48 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:49.730738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:49.731285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:49.733242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:49.733923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:49.740372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:49.740844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:49.741270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:49.741946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:49.742395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:49.742811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:49.760912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:49.761526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:49.764030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:49.770463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:49.770946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:49.771383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:49.772080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:49.772561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:49.772992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:49.882944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:49.892342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6d76596-9c09-4f19-91e6-2ebc74b1ccad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1755 microversion: 2.1 time: 0.165427 Sep 28 12:19:49.893132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 322/661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:49.906759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:49.914581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ed34343c-f94e-40a5-aeb0-6405c9ff5efe tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1314 microversion: 2.1 time: 0.157477 Sep 28 12:19:49.915133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 340/662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:49 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:50.916124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:50.916763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:50.923855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:50.924356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:50.924795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:50.925482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:50.925934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:50.926355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:50.936609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:50.937219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:50.944685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:50.945362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:50.945795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:50.946665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:50.947121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:50.947553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:51.071790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:51.075855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:51.082002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56c5c369-e1aa-4885-8d1a-718da6811f63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1758 microversion: 2.1 time: 0.169771 Sep 28 12:19:51.082640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 323/663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:51.189727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:51.197663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-73858696-e539-4990-bb67-3e3c4a34faa7 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1498 microversion: 2.1 time: 0.264993 Sep 28 12:19:51.198241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 341/664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:50 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1498 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:19:51.300714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:51.301211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:51.309216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:51.309704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:51.310141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:51.310838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:51.311297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:51.311695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:51.337587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:19:51.415254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-788d7b67-1265-4e55-b30d-9c0e22761059 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 204 len: 0 microversion: 2.1 time: 0.118396 Sep 28 12:19:51.415843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 324/665] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:19:51 2022] DELETE /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:19:51.424024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:51.424670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:51.430530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:51.431008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:51.431609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:51.432299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:51.432772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:51.433262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:51.573210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:51.581465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d83f41b0-9045-4ad2-9497-6091dc6773d2 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1504 microversion: 2.1 time: 0.161391 Sep 28 12:19:51.582031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 342/666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:51 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:52.604741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:52.605435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:52.611865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:52.612280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:52.612740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:52.613421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:52.613864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:52.614282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:52.752338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:52.760068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25413867-f4d5-43fb-a6ee-70955a1196c4 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1504 microversion: 2.1 time: 0.159570 Sep 28 12:19:52.760703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 325/667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:52 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:53.534634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fc512e-490e-4baf-98e1-de0f1d279809", "name": "network-vif-deleted", "tag": "02fb5b91-4965-4806-b72a-455fdfa502fa"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:19:53.545657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:19:53.545869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:19:53.560556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:53.560921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:53.561351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:53.574913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] Creating event network-vif-deleted:02fb5b91-4965-4806-b72a-455fdfa502fa for instance f0fc512e-490e-4baf-98e1-de0f1d279809 on hv-cinder-85919 Sep 28 12:19:53.579645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-653120e7-3619-434c-8c0c-c29359a8446f req-7d1f5d0b-a3ac-4725-a782-effa4275304b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052089 Sep 28 12:19:53.580362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 343/668] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:19:53.783192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:53.783888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:53.790715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:53.791279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:53.791928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:53.792914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:53.793567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:53.794079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:53.837674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:53.838163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:53.838612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:53.839181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lazy-loading 'fault' on Instance uuid f0fc512e-490e-4baf-98e1-de0f1d279809 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:19:53.892478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3682aef6f8415f9a5cac2db2f7bff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5209c6077a4fd592a983d1430f630b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:19:53.900460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eeb23c55-4967-444d-bffc-b997ad20f665 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 200 len: 1304 microversion: 2.1 time: 0.120992 Sep 28 12:19:53.901023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 326/669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:53 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:19:54.923911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:19:54.924644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] [instance: f0fc512e-490e-4baf-98e1-de0f1d279809] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:19:54.930772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:54.931250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:54.931685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:54.932400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:19:54.932856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:19:54.933279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:19:54.937510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:19:54.947663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] HTTP exception thrown: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Request method failure captured: Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 HTTP/1.1 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDtWgXn9keFFVsdcphUlxm20iG2N2wGmLBM9x53MrHobXbvdrfaKwBSq1x1iJNtLtvxhD2cCOfFXMXeYiVJ3L6BOAoEOW9Ip91eElGvXiGJKexOsKC6hATxEvpRLBfUVXbrKf64gS6UN0nd-YigvP-uvl0PyDkrHaO0i7LjfgAYoCQ8 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 1d5209c6077a4fd592a983d1430f630b Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:19:54.950026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d5209c6077a4fd592a983d1430f630b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d5209c6077a4fd592a983d1430f630b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 1d5209c6077a4fd592a983d1430f630b Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesActionsTest-2094945513 Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesActionsTest-2094945513-project Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 2b3682aef6f8415f9a5cac2db2f7bff9 Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesActionsTest-2094945513-project Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. Sep 28 12:19:54.951530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'f0fc512e-490e-4baf-98e1-de0f1d279809'} Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:19:54.952391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. Sep 28 12:19:54.953939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:19:54.955192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] Returning 404 to user: Instance f0fc512e-490e-4baf-98e1-de0f1d279809 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:19:54.955192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-85d025a3-98dd-4a45-bd37-2253e00a21d1 tempest-VolumesActionsTest-2094945513 tempest-VolumesActionsTest-2094945513-project] 10.222.0.26 "GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809" status: 404 len: 111 microversion: 2.1 time: 0.032203 Sep 28 12:19:54.955192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 344/670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:19:54 2022] GET /compute/v2.1/servers/f0fc512e-490e-4baf-98e1-de0f1d279809 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:21:10.975298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:21:10.975872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action (ip 10.222.0.26) !!! Sep 28 12:21:10.976602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:10.977857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:10.983667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1215285221"}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:21:10.984200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:10.994093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:10.994622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:10.994998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:10.995700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:10.996149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:10.996596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:11.243471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.network.security_group_api [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Removing security group 6a4e8423-1d23-44ff-b79e-a8213a845e7c from port 22f54f6e-b865-438e-b88a-a3184afa088a Sep 28 12:21:11.802006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c379d27-55b8-407e-a9ea-95eb15a2616d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action" status: 202 len: 0 microversion: 2.1 time: 0.828952 Sep 28 12:21:11.810769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=42 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:11.813611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 327/671] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:21:10 2022] POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:21:11.901217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:21:11.912541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:11.913289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:11.913944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:11.927798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] Creating event network-changed:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:21:11.933671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-eb311a15-368c-4fea-b210-a1d55c7cfd90 req-8194fee9-2c44-45bd-9379-0ae37eac1df4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127370 Sep 28 12:21:11.934874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 345/672] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:12.861599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:12.862106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:12.869471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:12.869951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:12.870459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:12.871354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:12.871864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:12.872484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:12.931754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:21:12.942667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:12.943143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:12.943806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:12.958389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] Creating event network-changed:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:21:12.964859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-51d0ccbe-1944-428c-9453-81d8a33540f8 req-5c30f7b2-c3f7-4ffd-946d-8b7e3439afbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104339 Sep 28 12:21:12.965824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 346/673] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:13.027336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lazy-loading 'services' on Instance uuid 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:21:13.151649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2e17caa2-c6fd-4bf7-8212-e2ebeea141b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments/a18d01db-bf92-41d3-929d-b0be33a0483d" status: 202 len: 0 microversion: 2.1 time: 0.293950 Sep 28 12:21:13.152460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 328/674] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 28 12:21:12 2022] DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments/a18d01db-bf92-41d3-929d-b0be33a0483d => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:21:13.166828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:13.169090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:13.175807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:13.176694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:13.177606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:13.178745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:13.179522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:13.180186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:13.214333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-edd9abcc-b2b3-409e-9c01-208ac8b270e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055231 Sep 28 12:21:13.215638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 347/675] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:21:14.236341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:14.238579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:14.245604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:14.246087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:14.246540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:14.247243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:14.247696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:14.248119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:14.278472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-843dcb60-ed3f-42ed-8f32-d455b1b3a9ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Sep 28 12:21:14.279034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 329/676] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:15.290684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:15.292909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:15.299279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:15.299757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:15.300198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:15.300914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:15.301368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:15.301793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:15.331255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b9cd9d59-aabc-4418-80f1-269c868c5dc0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Sep 28 12:21:15.331818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 348/677] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:16.343733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:16.345868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:16.352552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:16.353038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:16.353475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:16.354162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:16.354615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:16.355041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:16.384465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6df02819-49e3-46cb-9828-89566e22d737 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 28 12:21:16.385023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 330/678] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:17.396710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:17.398876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:17.405318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:17.405857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:17.406211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:17.406894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:17.407340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:17.407803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:17.436697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0ad1c349-d51e-4ff0-b1e5-93d05cfd0722 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Sep 28 12:21:17.437252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 349/679] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:18.449288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:18.451902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:18.458338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:18.458819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:18.459252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:18.459950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:18.460426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:18.460856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:18.494074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52b06f18-bf77-4f1e-9cc3-3a060d60f81a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Sep 28 12:21:18.499383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 331/680] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:19.506657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:19.508844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:19.515165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:19.515634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:19.516059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:19.516768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:19.517215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:19.517631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:19.546817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2ba6836f-1009-4b83-abee-fc3be93bda0e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Sep 28 12:21:19.547374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 350/681] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:20.559261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:20.561416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:20.568499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:20.568982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:20.569419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:20.570440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:20.570574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:20.570960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:20.601887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-158b4c1d-72e6-4ed3-a358-5619221086f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Sep 28 12:21:20.601887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 332/682] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:21.613134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:21.615337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:21.621693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:21.622163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:21.622589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:21.623274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:21.623724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:21.624145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:21.652748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-14e5f704-535c-43d9-ab2b-a51b681d324a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Sep 28 12:21:21.653308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 351/683] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:22.666038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:22.668206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:22.675236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:22.675707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:22.676131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:22.676836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:22.677283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:22.677701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:22.712229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-73d14eb9-7553-443f-87c8-f68fb0d0f088 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050098 Sep 28 12:21:22.712840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 333/684] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:23.725831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:23.728023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:23.735066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:23.735539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:23.735969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:23.736680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:23.737132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:23.737555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:23.767286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-668e8002-0304-4bfb-93b1-a02923645bf4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Sep 28 12:21:23.768027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 352/685] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:24.888602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:24.891357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:24.897178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:24.897656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:24.898087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:24.898771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:24.899224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:24.899643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:24.927631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-09642d32-62d2-4aa3-b5b4-76ac877407f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151971 Sep 28 12:21:24.928181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 334/686] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:25.942633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:25.942633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:25.951378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:25.951863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:25.952292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:25.955680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:25.955680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:25.955680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:25.986510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bffffbdc-2f24-4dd8-92a5-0dac6d74da5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051392 Sep 28 12:21:25.987077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 353/687] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:26.998930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:27.001503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:27.007824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:27.008298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:27.008758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:27.009441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:27.009892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:27.010313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:27.039754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-252b2105-3eae-4646-b249-10ade0cb15f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Sep 28 12:21:27.040322 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 335/688] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:28.052472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:28.054624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:28.061009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:28.061490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:28.061932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:28.062620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:28.063675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:28.064103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:28.092437 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d9d3ae11-a2f1-4de6-a44c-a799669ba0b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Sep 28 12:21:28.092984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 354/689] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:29.104850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:29.106981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:29.113293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:29.113765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:29.114192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:29.114867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:29.115312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:29.115730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:29.144178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6886ac70-bc95-4d29-822c-1424e8d315b2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Sep 28 12:21:29.144751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 336/690] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:30.156951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:30.159156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:30.165454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:30.165929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:30.166356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:30.167032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:30.167477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:30.168014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:30.196524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b3f7561e-9b86-4469-93e8-8a62bb80b29b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Sep 28 12:21:30.197061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 355/691] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:31.208689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:31.210820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:31.217131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:31.217604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:31.218032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:31.218712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:31.219155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:31.219576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:31.248338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d07cd75-d66c-41b2-9801-020f2c5d09cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Sep 28 12:21:31.248870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 337/692] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:32.261568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:32.263700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:32.270583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:32.271055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:32.271483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:32.272158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:32.272629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:32.273051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:32.301112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6d329d80-f356-4b41-b767-829840d7c651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Sep 28 12:21:32.301652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 356/693] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:33.313767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:33.315861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:33.322259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:33.322725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:33.323147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:33.323828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:33.324271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:33.324714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:33.352599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5a7b778-5adb-4812-a27a-dd9ac4a58839 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Sep 28 12:21:33.353126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 338/694] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:34.364757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:34.366886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:34.373676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:34.374150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:34.374582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:34.375269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:34.375727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:34.376147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:34.404720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-044e4a8b-7e7e-48b0-aa66-c5554b8627be tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Sep 28 12:21:34.405268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 357/695] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:35.417616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:35.419732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:35.426727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:35.427200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:35.427625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:35.428301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:35.428845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:35.429258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:35.456916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-318e5001-73a7-48a0-b8a6-2dfa6dabb6a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Sep 28 12:21:35.457451 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 339/696] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:36.469062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:36.471227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:36.477592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:36.478074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:36.478507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:36.479196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:36.479647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:36.480076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:36.510731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-97789d36-9221-47f6-840b-1bb0719da406 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Sep 28 12:21:36.511294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 358/697] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:37.523066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:37.525263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:37.531472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:37.531940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:37.532402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:37.533082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:37.533528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:37.533945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:37.561674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd013e0d-6395-4a5d-93da-4aa092f41e21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Sep 28 12:21:37.562209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 340/698] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:38.574191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:38.576376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:38.583201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:38.583664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:38.584095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:38.584807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:38.585258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:38.585682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:38.614902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-824e32f3-ec8d-4a77-9ac3-b9bae578e74b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Sep 28 12:21:38.615447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 359/699] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:39.628223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:39.630419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:39.636759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:39.637249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:39.637676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:39.638371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:39.638818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:39.639245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:39.668739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f4b4178a-d4ca-4efe-b8bf-54f5726be13d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Sep 28 12:21:39.669260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 341/700] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:40.682570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:40.684853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:40.691755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:40.692257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:40.692728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:40.693427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:40.693880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:40.694301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:40.724781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-561ab308-0b42-41fa-a55e-7d78413f447e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Sep 28 12:21:40.725343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 360/701] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:41.737068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:41.739283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:41.741773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=31 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:41.747620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:41.748106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:41.748571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:41.749266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:41.749718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:41.750144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:41.753860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:41.780038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-06b52d03-864a-4191-afee-fae68d96f340 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Sep 28 12:21:41.780840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 342/702] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:42.792316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:42.794458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:42.796867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=33 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:42.802896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:42.803379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:42.803814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:42.804541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:42.804990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:42.805411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:42.808010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=89 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:21:42.835151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ccbab4d2-4171-42ed-8c1f-38fad70b1f0f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 Sep 28 12:21:42.835711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 361/703] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:43.846897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:43.849336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:43.855893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:43.856411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:43.856842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:43.857527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:43.857972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:43.858388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:43.887887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a8af049d-83c2-43c9-ab34-9fa39522af70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Sep 28 12:21:43.888457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 343/704] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:44.900156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:44.902309 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:44.909406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:44.909875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:44.910301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:44.911007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:44.911448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:44.911863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:44.940628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7dc5eba5-39c3-4a05-a020-7c6e6cfb3344 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Sep 28 12:21:44.941179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 362/705] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:45.951760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:45.953967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:45.960272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:45.960771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:45.961197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:45.961873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:45.962315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:45.962731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:45.992465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d648a15-7581-4bd8-88a2-f76c99f488e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Sep 28 12:21:45.993071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 344/706] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:47.005509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:47.007683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:47.014184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:47.014659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:47.015094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:47.015904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:47.016231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:47.016680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:47.045340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3855cc8f-c385-4ac4-ac63-53c03b427dc8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Sep 28 12:21:47.045904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 363/707] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:48.063254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:48.065564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:48.071868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:48.072374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:48.072809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:48.073491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:48.073938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:48.074361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:48.104883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7805fc86-a268-42d4-acce-ce504dff263f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Sep 28 12:21:48.105464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 345/708] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:49.118159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:49.120275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:49.126638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:49.127107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:49.127534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:49.128210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:49.128726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:49.129146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:49.158511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a9090b81-34ab-4084-bf14-368dbae1822f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Sep 28 12:21:49.159079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 364/709] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:50.170614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:50.173343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:50.179588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:50.180061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:50.180522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:50.181204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:50.181647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:50.182065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:50.210412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a2e906f-1352-467d-9a00-56b3ed591d5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Sep 28 12:21:50.210967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 346/710] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:51.222240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:51.224719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:51.231045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:51.231526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:51.231963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:51.232691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:51.233151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:51.233581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:51.264774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e569f62a-ba76-4514-994b-d64ee4b7c2b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046424 Sep 28 12:21:51.265336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 365/711] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:52.277412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:52.279643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:52.287086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:52.287566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:52.287998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:52.288712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:52.289165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:52.289586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:52.318501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c57d8a6c-19aa-457e-96e1-b96f3a2e77fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Sep 28 12:21:52.319069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 347/712] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:53.332234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:53.334620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:53.340973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:53.341447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:53.341870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:53.342558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:53.343001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:53.343419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:53.372432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c2f799e6-0854-4758-a941-117d879a5ee7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Sep 28 12:21:53.373029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 366/713] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:21:54.385627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:54.387800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:54.393777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:54.394249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:54.394681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:54.395360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:54.395810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:54.396227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:54.425225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cb50f208-2439-412e-94d6-ede727a0ce60 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Sep 28 12:21:54.425786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 348/714] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:55.438203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:55.440414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:55.446798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:55.447269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:55.447698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:55.448405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:55.448850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:55.449271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:55.478904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e78d7cbf-b23d-46dc-84ca-0d86fc6909bf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Sep 28 12:21:55.480277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 367/715] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:56.491465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:56.494160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:56.500700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:56.501178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:56.501607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:56.502295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:56.502746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:56.503166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:56.532642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6726e237-eb65-4adb-8340-1a4079ebf541 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 28 12:21:56.533204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 349/716] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:57.544354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:57.546991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:57.553355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:57.553829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:57.554255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:57.555076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:57.555522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:57.555937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:57.585355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-166dcff3-5329-4243-bcd6-fb2ce06d1649 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Sep 28 12:21:57.585911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 368/717] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:58.597734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:58.600188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:58.606547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:58.607024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:58.607463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:58.608145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:58.608622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:58.609045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:58.637760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2aea60c9-f05f-4339-ab6d-cce6f2d39e63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Sep 28 12:21:58.638318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 350/718] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:21:59.650736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:21:59.652930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:21:59.659855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:59.660365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:59.660813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:59.661507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:21:59.661965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:21:59.662394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:21:59.691112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-70964c91-39f2-4970-a43d-52836773ee16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Sep 28 12:21:59.691877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 369/719] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:21:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:00.702997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:00.705183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:00.711454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:00.711933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:00.712398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:00.713095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:00.713549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:00.713980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:00.743713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8dec2525-ad83-4ca5-a6e7-23cec8af3054 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Sep 28 12:22:00.744211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 351/720] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:01.755915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:01.758123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:01.764592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.765075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.766051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.766743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:01.767191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:01.767619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:01.797459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f3060b58-7c86-45c1-ba0d-a1e87aef4560 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Sep 28 12:22:01.798028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 370/721] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:02.809873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:02.812004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:02.818394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:02.818872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:02.819303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:02.819984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:02.820462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:02.820892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:02.851358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf0c433c-8218-4ba4-870d-e55849ed8807 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Sep 28 12:22:02.851925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 352/722] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:03.863523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:03.865702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:03.872001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:03.872510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:03.872942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:03.873627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:03.874074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:03.874493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:03.903513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-392e359d-46fb-490e-bcda-e851f985d6e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 28 12:22:03.904101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 371/723] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:04.916346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:04.918492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:04.925485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:04.925964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:04.926397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:04.927084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:04.927540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:04.927964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:04.957370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b663297d-1c00-4933-8124-807401a59932 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Sep 28 12:22:04.957915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 353/724] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:05.970001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:05.972078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:05.978816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:05.979302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:05.979737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:05.980465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:05.980920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:05.981343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:06.012288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2834a8aa-12d2-4581-9378-d6e1f260a986 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Sep 28 12:22:06.012885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 372/725] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:07.025401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:07.027536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:07.034729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:07.035206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:07.035640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:07.036353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:07.036810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:07.037236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:07.066362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f5e23219-9ae4-4fc4-8b40-5c3c702075c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Sep 28 12:22:07.066928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 354/726] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:08.078610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:08.080863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:08.087210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:08.087692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:08.088129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:08.088843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:08.089297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:08.089756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:08.121627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1eb79ff4-5bb7-4b62-bfb9-b2d64f0f80d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Sep 28 12:22:08.122193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 373/727] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:09.134772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:09.136918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:09.143272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:09.143745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:09.144175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:09.144891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:09.145342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:09.145763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:09.175692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36645f49-d9cc-4e8a-b8fa-6874cc4eab47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Sep 28 12:22:09.176259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 355/728] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:10.188355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:10.190499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:10.196868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:10.197350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:10.197794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:10.198480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:10.198937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:10.199369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:10.228331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4eeaf8e0-1950-4caf-85bd-75e9f7ad6e11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Sep 28 12:22:10.228892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 374/729] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:11.241168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:11.243343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:11.250671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:11.251140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:11.251566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:11.252247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:11.252720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:11.253140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:11.282803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d20c5b3c-7c10-4e40-a841-fa58532bbbe4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Sep 28 12:22:11.283359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 356/730] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:12.298228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:12.300414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:12.306921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:12.307484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:12.307919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:12.308634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:12.309163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:12.309554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:12.340238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e6f7a22d-eaff-4336-84bc-55290d42d5ba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048932 Sep 28 12:22:12.340907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 375/731] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:13.352846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:13.354983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:13.357263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:13.362626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:13.363104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:13.363536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:13.364235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:13.364713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:13.365138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:13.367712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:13.397722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b696a5c-598f-48f7-a87b-6e3c24b11a63 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Sep 28 12:22:13.398300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 357/732] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:14.410287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:14.412458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:14.414757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:14.419973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:14.420470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:14.420894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:14.421655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:14.422099 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:14.422408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:14.426275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=90 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:14.452229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e9dc6097-8370-4a8e-b7f1-248d6bbfbdd0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Sep 28 12:22:14.457636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 376/733] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:15.465250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:15.467411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:15.474855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:15.475324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:15.475749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:15.476463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:15.476914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:15.477332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:15.507373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1063fab4-84fc-47f6-bf0b-77cf66de40c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045921 Sep 28 12:22:15.508068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 358/734] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:16.519050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:16.521282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:16.528044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:16.528564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:16.528998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:16.529686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:16.530181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:16.531099 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:16.561493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6baa4dc5-bc9b-44ec-a1cf-a06f2761ebbb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Sep 28 12:22:16.562090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 377/735] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:17.573459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:17.575591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:17.582008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:17.582616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:17.582921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:17.583617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:17.584070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:17.584529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:17.614299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9f64ea39-7e69-4521-8843-0e7bcf8ee95d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Sep 28 12:22:17.614862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 359/736] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:18.626745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:18.629742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:18.637482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:18.638492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:18.641206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:18.642189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:18.642857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:18.643491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:18.675391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b2dd94a9-21f9-498d-82c2-0b9d0c65f5fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052573 Sep 28 12:22:18.675945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 378/737] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:22:19.687936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:19.690074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:19.696506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:19.696983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:19.697413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:19.698096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:19.698541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:19.698983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:19.728147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-472070b5-d9c4-4ace-aba1-2ecbc8f07fd9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Sep 28 12:22:19.728720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 360/738] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:20.740053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:20.742257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:20.748654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:20.749059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:20.750044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:20.750743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:20.751196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:20.751625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:20.780792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3dcee209-105b-42ed-8cb4-05147781a2b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Sep 28 12:22:20.781356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 379/739] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:21.792100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:21.794298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:21.800493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:21.800977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:21.801414 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:21.802115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:21.802571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:21.802998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:21.832662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85d3f4de-cab6-41a8-a949-07bd5e2495b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Sep 28 12:22:21.833225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 361/740] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:22.845799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:22.847930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:22.854826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:22.855314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:22.855755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:22.856616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:22.857078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:22.857509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:22.887329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2affba6d-4146-405e-91c3-784e81c3be47 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046014 Sep 28 12:22:22.892392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 380/741] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:23.899664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:23.901811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:23.908729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:23.909203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:23.909638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:23.910326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:23.910773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:23.911194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:23.940626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e63d9dcf-5cec-47f7-b882-d63f8b3c4d5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Sep 28 12:22:23.941185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 362/742] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:24.954088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:24.959430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:24.965983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:24.966461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:24.966890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:24.967594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:24.968083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:24.968519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:24.997897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f42650ce-468d-4211-a85f-518112eeba82 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048606 Sep 28 12:22:24.998451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 381/743] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:26.010895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:26.012999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:26.019465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:26.020001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:26.020495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:26.021193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:26.021644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:26.022068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:26.051947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f59ac11f-4dbc-48f1-b2eb-9cd54992daec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Sep 28 12:22:26.052546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 363/744] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:22:27.064237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:27.066497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:27.073188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:27.073761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:27.074223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:27.074923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:27.075501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:27.075971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:27.109712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-144586e1-7262-4269-936e-6fd18499a7a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Sep 28 12:22:27.110275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 382/745] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:28.121886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:28.123996 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:28.130778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:28.131259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:28.131698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:28.132577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:28.133037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:28.133458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:28.163785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-061e94d7-1fb3-4ee8-93f2-408217266b40 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Sep 28 12:22:28.164355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 364/746] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:29.175129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:29.177381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:29.183665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:29.184146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:29.184627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:29.185331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:29.185761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:29.186205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:29.218239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a4e30565-3838-4efa-affa-f96c2bc9e4e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047199 Sep 28 12:22:29.218798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 383/747] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:30.230667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:30.232881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:30.239538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:30.240019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:30.240483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:30.241182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:30.241633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:30.242055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:30.273191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9fbd7d33-f621-4bf5-a56b-2826bdd08b58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Sep 28 12:22:30.273755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 365/748] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:31.284662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:31.286801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:31.293400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:31.293882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:31.294314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:31.295008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:31.295459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:31.296412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:31.326347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-02bcd4b1-3810-44fa-bedc-cfcf85530506 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045678 Sep 28 12:22:31.326907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 384/749] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:32.337598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:32.339793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:32.346890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:32.347376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:32.347802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:32.348531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:32.348977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:32.349410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:32.379066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72c02e71-bfc9-4ca1-867e-887ec099d0ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Sep 28 12:22:32.379609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 366/750] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:33.391074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:33.393281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:33.399537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:33.400021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:33.400494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:33.401205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:33.401660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:33.402090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:33.431482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c634f870-8b2d-44b6-92f5-3b914c51c781 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Sep 28 12:22:33.432032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 385/751] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:34.442899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:34.445148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:34.451578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:34.452067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:34.452530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:34.453218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:34.453668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:34.454088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:34.484723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df0ad3e3-31c7-4fd5-9bf5-553cd4446b12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 28 12:22:34.485283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 367/752] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:35.498648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:35.501308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:35.508906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:35.509393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:35.509832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:35.510529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:35.510985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:35.511525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:35.542520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b133a6b3-e575-43dd-a815-2bb45a3adbe0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047778 Sep 28 12:22:35.543087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 386/753] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:36.554841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:36.556995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:36.564393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:36.564946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:36.565381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:36.566072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:36.566521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:36.566942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:36.595741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3f2c9c7-1bca-4b3e-a155-2103e4bb1224 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Sep 28 12:22:36.596286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 368/754] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:22:37.608880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:37.611055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:37.621325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:37.621877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:37.622320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:37.623025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:37.623478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:37.623906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:37.663226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-71059f38-5ebb-40c0-b427-73949ca79f18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058817 Sep 28 12:22:37.663783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 387/755] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:38.676758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:38.679055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:38.685458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:38.685932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:38.686361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:38.687055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:38.687499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:38.687917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:38.718348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03b036cb-261d-4292-b570-4ad0813bc57b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Sep 28 12:22:38.718908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 369/756] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:39.731452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:39.733801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:39.740214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:39.740728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:39.741160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:39.741852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:39.742305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:39.742755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:39.772428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9585f99e-4775-4a07-a016-3383021259b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 28 12:22:39.772990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 388/757] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:40.789189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:40.791317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:40.799056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:40.799535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:40.799966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:40.800688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:40.801131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:40.801547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:40.830604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee5ff159-650b-45d6-b8c0-0e84a95e4101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049681 Sep 28 12:22:40.831152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 370/758] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:22:41.842321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:41.844726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:41.851646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:41.852127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:41.852589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:41.853281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:41.853732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:41.854156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:41.884282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ff2e1a9f-3da7-4bc7-85aa-76af9c61d220 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Sep 28 12:22:41.884868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 389/759] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:42.897480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:42.899958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:42.906743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:42.907229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:42.907664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:42.908404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:42.908862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:42.909292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:42.938338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb55b3c4-b164-40a7-8ee1-a10e74aca121 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045520 Sep 28 12:22:42.938893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 371/760] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:43.950718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:43.953028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:43.959398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:43.959876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:43.960338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:43.961030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:43.961479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:43.961906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:43.990983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ab85db87-3a70-4c13-b5d2-bbb39629cb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Sep 28 12:22:43.991558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 390/761] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:45.005125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:45.007314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:45.009747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:45.015783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:45.016458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:45.016895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:45.017593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:45.018048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:45.018474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:45.022271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:45.047808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab08f482-8755-44be-a7f3-27c9169672a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Sep 28 12:22:45.048384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 372/762] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:46.060183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:46.063059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:46.065408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:46.070824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:46.071314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:46.071754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:46.072493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:46.072947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:46.073371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:46.077140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=90 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:22:46.102707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7fe9eeef-d094-4eac-903e-7455e478ad1d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046424 Sep 28 12:22:46.103264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 391/763] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:47.115026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:47.117159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:47.123450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:47.124549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:47.124981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:47.125661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:47.126111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:47.126529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:47.154467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-471e49c4-99d9-4cd6-b5c3-e4389783b95c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Sep 28 12:22:47.155553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 373/764] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:48.167059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:48.169246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:48.176221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:48.176738 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:48.177165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:48.177874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:48.178320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:48.178739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:48.206867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d68f537c-ef2b-4989-a993-d43fbcdf1df3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Sep 28 12:22:48.207408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 392/765] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:49.219024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:49.221219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:49.227762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:49.228243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:49.228711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:49.229400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:49.229852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:49.230277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:49.259844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ac44f8b-36a0-4b8a-b04d-cbb3c03a8586 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 28 12:22:49.260415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 374/766] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:50.271386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:50.273539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:50.279941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:50.280443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:50.280879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:50.281569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:50.282016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:50.282435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:50.310590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c117c98d-0b56-4f72-b09c-e98b8d908ca4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Sep 28 12:22:50.311662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 393/767] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:51.322999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:51.325250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:51.327938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:22:51.328071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments (ip 10.222.0.26) !!! Sep 28 12:22:51.337363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:51.337846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:51.338282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:51.338977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:51.339434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:51.339855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:51.369393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ec61a0e9-418f-49a0-8155-79e023417405 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050410 Sep 28 12:22:51.369943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 375/768] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:52.381655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:52.383808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:52.386241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:22:52.386385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments (ip 10.222.0.26) !!! Sep 28 12:22:52.392842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:52.393325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:52.393755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:52.394447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:52.394900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:52.395326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:52.426149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7bb30245-81eb-4d0a-bf85-81b24bcbadb5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048391 Sep 28 12:22:52.426710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 394/769] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:53.438098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:53.440229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:53.446565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:53.447100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:53.447484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:53.448269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:53.448771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:53.449194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:53.478245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88357039-62a0-4ca6-b739-a687bfda4835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Sep 28 12:22:53.478793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 376/770] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:54.490775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:54.492995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:54.499583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:54.500061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:54.500534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:54.501226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:54.501677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:54.502098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:54.531605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9c50cce2-2e2c-4b2c-b26b-c7bbbb7e8c6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Sep 28 12:22:54.532154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 395/771] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:55.543020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:55.545966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:55.552286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:55.552855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:55.553344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:55.554105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:55.554589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:55.555035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:55.583232 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-23ad3f2b-ffc8-4c3e-abad-3c2aaa33a1eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Sep 28 12:22:55.583782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 377/772] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:56.594857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:56.597082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:56.603599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:56.604081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:56.604559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:56.605244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:56.605697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:56.606122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:56.635480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0407d5d1-9f96-4577-9793-9ec9bc68d6da tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Sep 28 12:22:56.636025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 396/773] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:57.647006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:57.649271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:57.656534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:57.657039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:57.657454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:57.658145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:57.658594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:57.659015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:57.688459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-026be93c-b5cf-45d5-8212-6b32b9f57480 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Sep 28 12:22:57.688938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 378/774] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:58.700442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:58.703275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:58.711982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:58.712510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:58.712942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:58.715850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:58.716333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:58.716767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:58.749126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b06dacb1-f6fa-4f91-9b16-04f9c6893061 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052290 Sep 28 12:22:58.749588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 397/775] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:22:59.761465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:22:59.763691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:22:59.770600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:59.771078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:59.771510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:59.772194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:22:59.772673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:22:59.773101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:22:59.801678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1ce273e-60fe-4160-b852-ce39fb09f101 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Sep 28 12:22:59.802228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 379/776] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:22:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:00.813417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:00.815671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:00.822137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:00.822641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:00.823075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:00.823759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:00.824209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:00.824660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:00.853842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f598e01e-62aa-451b-b9d6-e60e8cc77dda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Sep 28 12:23:00.854392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 398/777] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:01.866623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:01.868759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:01.875022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.875491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.875915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:01.876627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:01.877069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:01.877485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:01.907340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc7f187a-d1aa-44aa-8ee6-d19dbd5d6dff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Sep 28 12:23:01.907877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 380/778] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:02.919319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:02.921505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:02.927728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.928193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.928649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.929329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:02.929773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:02.930193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:02.962013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-78638a99-b849-4b52-a475-7b036df77cec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Sep 28 12:23:02.962619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 399/779] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:03.973875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:03.976279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:03.982660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.983145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.983585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:03.984279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:03.984759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:03.985180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:04.013950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c970bf43-986c-42f7-ad82-705399fd18fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Sep 28 12:23:04.014503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 381/780] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:05.026669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:05.028971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:05.035263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.035740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.036171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.036876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:05.037323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:05.037743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:05.067646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ab1606f7-cb71-43c9-adfa-b6b1b28ded2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Sep 28 12:23:05.068227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 400/781] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:06.079501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:06.081655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:06.088004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.088522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.088964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.089664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:06.090117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:06.090540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:06.119849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38300358-1c02-4437-8ade-ea50113e499b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Sep 28 12:23:06.120422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 382/782] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:07.132604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:07.134792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:07.140858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:07.141342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:07.141777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:07.142463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:07.142914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:07.143340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:07.172422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-277da053-7576-4f52-95ff-15de0d162476 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Sep 28 12:23:07.172966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 401/783] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:08.184598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:08.187242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:08.193694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.194177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.194607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.195293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:08.195745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:08.196171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:08.224988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1d4f4e54-08da-4b24-be2d-e094856dafec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Sep 28 12:23:08.225804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 383/784] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:09.237011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:09.239233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:09.245669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.246143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.246573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.247259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:09.247705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:09.248653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:09.277933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-11a49639-05ec-455b-adaf-5057fc22c9d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Sep 28 12:23:09.278504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 402/785] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:10.289266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:10.291415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:10.297783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.298245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.298679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.299366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:10.299819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:10.300261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:10.328615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e322debb-85c5-4383-9e5b-e56e66bacb32 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043180 Sep 28 12:23:10.329152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 384/786] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:11.340813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:11.343352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:11.349663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.350134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.350827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.351504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:11.351948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:11.352390 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:11.383074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bb7328c0-2bb6-4bbd-a024-bde58672f3ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Sep 28 12:23:11.383634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 403/787] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:12.395541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:12.397694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:12.404027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.405194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.405631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.406318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:12.406768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:12.407191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:12.435517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dce0f58e-1387-4d73-96b5-19e8ed82e15e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Sep 28 12:23:12.436083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 385/788] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:13.448026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:13.450206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:13.456526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.456996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.457419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.458124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:13.458566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:13.458981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:13.489458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-acd7f1d0-c286-4f0b-b77b-85d129530b48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Sep 28 12:23:13.490023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 404/789] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:14.502225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:14.504410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:14.510817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:14.511231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:14.511659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:14.512356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:14.512807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:14.513222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:14.541729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-116a9cbb-df47-47a1-96b3-87ea169bb54f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044001 Sep 28 12:23:14.542267 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 386/790] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:15.554461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:15.556650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:15.558597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:23:15.558728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:23:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments (ip 10.222.0.26) !!! Sep 28 12:23:15.565875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.566350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.566785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.567468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:15.567913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:15.568348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:15.596712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f7a21595-966a-477c-96fc-1ab012bcfc22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046163 Sep 28 12:23:15.597248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 405/791] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:16.609268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:16.611376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:16.613667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:16.618703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.619172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.619599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.620279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:16.620742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:16.621186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:16.624166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:16.650843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9a22132-8aaa-4dc5-af01-f87a4c99addf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Sep 28 12:23:16.651387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 387/792] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:17.662962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:17.665182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:17.667454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:17.672654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.673132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.673566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.674251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:17.674701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:17.675120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:17.678875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=90 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:17.704465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0de96b21-1769-4655-b8ea-b88d0b293227 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Sep 28 12:23:17.705016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 406/793] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:18.717007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:18.719380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:18.726797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.727355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.727803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.728524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:18.728976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:18.730004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:18.759623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db22deb2-9f85-44d8-b208-95f3e4d02662 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Sep 28 12:23:18.760114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 388/794] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:19.771992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:19.774148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:19.781204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.781674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.782100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.782777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:19.783224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:19.783641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:19.811790 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fb564e0a-5aa3-427c-a79e-fbfdd5c56bf2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Sep 28 12:23:19.812353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 407/795] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:20.824008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:20.826189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:20.832721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.833228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.833655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.834338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:20.834783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:20.835199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:20.864207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81418503-5682-4cf8-8a2f-0be81c645628 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Sep 28 12:23:20.864787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 389/796] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:21.877105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:21.879253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:21.885648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.886128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.886563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.887256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:21.887709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:21.888133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:21.916981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8dd7272-25ab-492b-9bd2-f10154f4e443 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Sep 28 12:23:21.917526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 408/797] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:22.929221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:22.931332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:22.938347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.938838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.939249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.939932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:22.940406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:22.940828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:22.968716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cf61ca3e-1669-4626-8517-6254aaa3b920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Sep 28 12:23:22.969260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 390/798] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:23.980638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:23.983477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:23.989872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.990343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.990773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:23.991488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:23.991937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:23.992374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:24.021723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-052a31d8-0d5a-4313-accc-24d7c36144e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Sep 28 12:23:24.022290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 409/799] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:25.034099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:25.036252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:25.042320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.042806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.043324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.044023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:25.044515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:25.044990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:25.074610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11146c7d-3890-46f7-892e-126ef91a440c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Sep 28 12:23:25.075156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 391/800] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:26.087625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:26.089849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:26.096222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.096739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.097178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.097874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:26.098329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:26.098755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:26.129852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fc9ca92a-0a54-4c39-a218-97a32c76dcf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Sep 28 12:23:26.130423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 410/801] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:27.141482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:27.143579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:27.149884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.150352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.150781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.151462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:27.151902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:27.152336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:27.181727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c627571-4433-4dc2-92ac-ef6c20063483 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Sep 28 12:23:27.182270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 392/802] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:28.194090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:28.196233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:28.202567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.203048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.203501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.204163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:28.204650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:28.205084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:28.234569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d358fca6-f526-4ec9-9711-01edf186f7db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Sep 28 12:23:28.235195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 411/803] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:29.246826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:29.249655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:29.256435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.256908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.257361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.258042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:29.258485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:29.258909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:29.287440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-699d7dc4-91e8-48ef-8210-02fef09d5e48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Sep 28 12:23:29.287984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 393/804] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:30.300671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:30.302890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:30.309329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.309801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.310864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.311550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:30.311998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:30.312444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:30.340924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f075b301-afab-4256-9fc8-931e5e66c878 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Sep 28 12:23:30.341507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 412/805] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:31.352445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:31.354548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:31.361354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.361827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.362258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.362934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:31.363377 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:31.363792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:31.394183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-977f2067-041b-4efe-bcf8-46591d53116d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Sep 28 12:23:31.394740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 394/806] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:32.406434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:32.408588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:32.413849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:32.414434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:32.415095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.415578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.416007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.416726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.417174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.417595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.421277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.421827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.422497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.423189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:32.423645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:32.424070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:32.447037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4d2f60fc-039f-4efc-8d90-827c31c62bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Sep 28 12:23:32.447621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 413/807] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:32.509415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lazy-loading 'services' on Instance uuid f70275a6-f5ea-4b01-b384-32c64c06551d {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:23:32.579161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [78cb6ce2-489e-4db4-a641-3c6b9578dea8] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:23:33.459082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:33.461264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:33.467871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.468383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.468818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.469507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:33.469958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:33.470381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:33.500744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1301c353-b4be-45f1-8f63-585d915604ce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Sep 28 12:23:33.501302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 414/808] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:23:33.585422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [78cb6ce2-489e-4db4-a641-3c6b9578dea8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40628. Sep 28 12:23:33.588867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3946822-37a3-42d8-b6b8-eb45b8acee1f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d/os-volume_attachments/198494c2-08af-4931-adb7-0684fbc93e14" status: 202 len: 0 microversion: 2.1 time: 1.179049 Sep 28 12:23:33.589486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 395/809] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 28 12:23:32 2022] DELETE /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d/os-volume_attachments/198494c2-08af-4931-adb7-0684fbc93e14 => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:23:34.513065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:34.515799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:34.522185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.522665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.523095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.523778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:34.524223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:34.524672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:34.552360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-14c00ff2-5539-498c-b877-1ef639cc7507 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Sep 28 12:23:34.552902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 415/810] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:35.566253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:35.568550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:35.574874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.575387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.575821 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.576619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:35.577072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:35.577563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:35.606866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b967f2f7-72c5-40e2-81e9-99a813437cb2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Sep 28 12:23:35.608023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 396/811] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:36.619007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:36.621161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:36.626984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.627472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.627879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.628602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:36.629047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:36.629469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:36.658566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e3fdc4f7-fafc-43a5-8afb-401c68b92677 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Sep 28 12:23:36.659115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 416/812] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:37.671681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:37.673870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:37.680109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.680620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.681048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.681726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:37.682171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:37.682604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:37.711731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2d0abca-1d51-487b-84b9-55cb065fd86e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Sep 28 12:23:37.712274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 397/813] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:38.734862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:38.737065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:38.743464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.743940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.744461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.745126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:38.745578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:38.746001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:38.775093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d69fae7d-c53a-41f2-8d99-06bde3f750e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 28 12:23:38.775650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 417/814] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:39.786847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:39.788992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:39.796073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.796572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.797004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.797680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:39.798122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:39.798537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:39.826331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8db95214-4db6-49d5-9634-460ce7b25281 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Sep 28 12:23:39.826871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 398/815] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:40.838565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:40.840743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:40.847438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.847920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.848383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.849072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:40.849550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:40.849971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:40.880379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c2130457-e763-4b10-aa13-519054871eed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Sep 28 12:23:40.880930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 418/816] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:41.893124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:41.895253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:41.901661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.902144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.902579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.903271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:41.904240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:41.904691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:41.933473 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5497abd-bfb2-43d7-9c16-daf86035dc10 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Sep 28 12:23:41.934014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 399/817] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:42.945721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:42.947887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:42.954944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.955420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.955852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.956567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:42.957018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:42.957445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:42.985837 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-936a4f12-fa20-4066-9dd7-764d258018d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Sep 28 12:23:42.986597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 419/818] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:43.998041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:44.000182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:44.006604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.007083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.007523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.008215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:44.008690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:44.009112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:44.038247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e394722d-7589-4162-98f1-efc716f7f8ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Sep 28 12:23:44.038786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 400/819] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:45.057990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:45.060577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:45.069639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:45.070151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:45.070565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.071256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:45.071700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:45.072167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:45.106115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-91a2752e-3451-43a5-b0b6-8fc1eaa75944 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055460 Sep 28 12:23:45.106700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 420/820] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:46.120114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:46.122371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:46.128926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.129409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.129837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.130529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:46.130977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:46.131398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:46.161772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a36c57f7-1e58-48d4-ac66-5f67a5276d8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Sep 28 12:23:46.162327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 401/821] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:47.174499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:47.176676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:47.182980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.183457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.183891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.184603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:47.185561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:47.185982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:47.214689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b9b9b37e-47d3-482c-a0cc-7e88376eaf26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Sep 28 12:23:47.215229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 421/822] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:48.227134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:48.229291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:48.231668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:48.236921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.237401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.237831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.238517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:48.239002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:48.239421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:48.241967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:48.270415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3275455-8bd8-4763-a3ce-1a209d77105c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047448 Sep 28 12:23:48.270967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 402/823] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:49.283286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:49.285485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:49.287841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=32 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:49.293305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.293825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.294306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.295012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:49.295512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:49.295960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:49.299942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=96 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:23:49.325962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c6b7797f-6738-468c-b870-a1e9c3dae229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Sep 28 12:23:49.326555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 422/824] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:50.338262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:50.340378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:50.346752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.347220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.347648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.348338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:50.348792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:50.349207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:50.378518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-24b60388-9fa2-4739-8f0d-9ed242c99966 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Sep 28 12:23:50.379065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 403/825] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:51.391312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:51.393537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:51.399883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.400381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.400809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.401489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:51.401934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:51.402352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:51.431641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-705bf889-763e-4a42-b721-6beb718cd08a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Sep 28 12:23:51.432192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 423/826] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:52.443773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:52.445912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:52.452866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.453346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.453780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.454493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:52.454941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:52.455362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:52.483838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-685282fa-a8ea-4da1-9d8e-ad97b4aeb39d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Sep 28 12:23:52.484594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 404/827] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:53.496255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:53.498567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:53.505127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.505598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.506082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.506767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:53.507213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:53.507631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:53.537638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-36e3cf2e-322a-4408-a45a-95cf3a4c618f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Sep 28 12:23:53.538195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 424/828] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:54.550192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:54.552429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:54.558292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.558765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.559195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.560092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:54.560644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:54.561068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:54.589955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-703f6afa-26bf-4431-95cc-d018d4633026 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Sep 28 12:23:54.590490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 405/829] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:55.603634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:55.605878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:55.612898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.613374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.613809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.614492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:55.614942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:55.615363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:55.643567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eb5df03b-67fa-4681-aedd-03829e799211 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Sep 28 12:23:55.644112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 425/830] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:56.655664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:56.657813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:56.664174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.664685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.665119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:56.665815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:56.666265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:56.666688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:56.694438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3c8f593-952d-47ff-9439-1e656988b341 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Sep 28 12:23:56.694979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 406/831] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:57.706605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:57.708893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:57.715229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:57.715709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:57.716144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:57.716859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:57.717314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:57.717739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:57.746300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b3405fb6-c11a-4ae5-813e-25d7f15ec699 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Sep 28 12:23:57.746785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 426/832] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:58.759086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:58.761259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:58.768130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:58.768636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:58.769063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:58.769743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:58.770186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:58.770603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:58.799323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7f0209d-f5b9-4df8-92fd-5035b242b647 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Sep 28 12:23:58.799882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 407/833] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:23:59.812433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:23:59.814705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:23:59.821380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.821864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.822302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.823892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:23:59.824378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:23:59.824811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:23:59.863804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4d890611-0522-4530-96a5-950c953f214c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056270 Sep 28 12:23:59.864373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 427/834] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:23:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:00.876711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:00.878885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:00.885423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.885909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.886347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.887044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:00.887496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:00.888586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:00.916632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-502e584b-5886-491e-b2b9-9409b16a5a16 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Sep 28 12:24:00.917215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 408/835] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:01.928601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:01.930834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:01.937923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.938396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.938833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.939510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:01.939956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:01.940403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:01.969271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5f76cd7e-18eb-4452-ba8f-dc8342f1c40a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Sep 28 12:24:01.969807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 428/836] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:02.981085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:02.983814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:02.990431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:02.990910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:02.991341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:02.992057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:02.992545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:02.992969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:03.021547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5ad4b5e-f211-4577-bce0-30ef83626bd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Sep 28 12:24:03.022109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 409/837] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:04.034333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:04.037560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:04.044670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:04.045151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:04.045588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:04.046288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:04.046743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:04.047176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:04.078242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-84eae659-eb40-48df-9634-a4ac9122ff59 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048026 Sep 28 12:24:04.078801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 429/838] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:05.090870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:05.093039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:05.099338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:05.099808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:05.100233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:05.100950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:05.101662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:05.102082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:05.130784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93d4ee33-f26d-46be-b153-eb5b60a79e87 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Sep 28 12:24:05.131313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 410/839] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:06.143734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:06.146046 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:06.152177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:06.152688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:06.153121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:06.153801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:06.154246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:06.154669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:06.182652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b1995c4d-d173-435f-b19e-d8e529761198 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Sep 28 12:24:06.183196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 430/840] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:07.196061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:07.198269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:07.205198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:07.205669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:07.206099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:07.206772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:07.207219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:07.207635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:07.236616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-155c4860-7c46-4504-85d5-54ab370ce4cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 28 12:24:07.237158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 411/841] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:08.249727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:08.251946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:08.258310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:08.258789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:08.259259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:08.259947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:08.260420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:08.260842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:08.289719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c5650b6e-0cf3-492d-965b-7c6174d1cefc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Sep 28 12:24:08.290268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 431/842] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:09.301907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:09.304011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:09.311275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:09.311739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:09.312163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:09.312880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:09.313323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:09.313737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:09.341526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-407b4603-f165-42e3-aba2-9d5157b5787f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Sep 28 12:24:09.342068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 412/843] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:10.354431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:10.356808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:10.363180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:10.363665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:10.364123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:10.364840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:10.365297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:10.365719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:10.394404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f5d8f496-7459-453d-b482-da3093433cc5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Sep 28 12:24:10.394948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 432/844] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:11.407067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:11.409224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:11.415514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:11.415979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:11.416443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:11.417119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:11.417562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:11.417978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:11.446506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-51fc50b2-55bf-45d8-90f2-ddac88cc9907 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Sep 28 12:24:11.447044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 413/845] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:12.458931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:12.461280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:12.467613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:12.468088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:12.468553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:12.469235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:12.469680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:12.470097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:12.502743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b6890e4c-9c92-4c1c-9165-f25c9503feb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047644 Sep 28 12:24:12.503356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 433/846] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:13.515865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:13.518040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:13.524453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:13.524934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:13.525365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:13.526054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:13.526507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:13.526931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:13.555100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-533638a0-44a8-42b1-99b9-a54e3930ce1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Sep 28 12:24:13.555640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 414/847] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:14.567993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:14.570387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:14.577347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:14.577827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:14.578262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:14.578952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:14.579410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:14.579836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:14.610040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8876939-72e1-4a66-a0f3-5248a0efb474 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046003 Sep 28 12:24:14.610693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 434/848] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:15.623175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:15.625328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:15.631593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:15.632063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:15.632537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:15.633219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:15.633661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:15.634079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:15.663335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-43d67ceb-1142-4fa2-97e6-aa15541259a7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Sep 28 12:24:15.663873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 415/849] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:16.675523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:16.677724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:16.684652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:16.685136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:16.685569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:16.686254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:16.686706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:16.687130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:16.716028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-913cf4de-fa26-48ce-9f0b-3811a765737d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Sep 28 12:24:16.716597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 435/850] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:17.728598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:17.730751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:17.737685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.738462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.738896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.739584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:17.740032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:17.740484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:17.769393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d41f2d95-0ffa-4e6e-baae-8b0d062923d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Sep 28 12:24:17.769875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 416/851] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:18.781609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:18.783753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:18.790072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:18.790545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:18.790975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:18.791652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:18.792104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:18.792545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:18.821827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-77962340-098e-457e-b0c9-a775712688c9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Sep 28 12:24:18.822377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 436/852] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:19.834791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:19.836980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:19.839269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:19.845116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.845590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.846019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.846701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:19.847148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:19.847569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:19.851577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:19.876477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b64f1ce5-e2d4-4e5e-b09a-f10da1af8403 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Sep 28 12:24:19.877023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 417/853] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:20.890146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:20.892345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:20.894603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:20.900089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:20.900591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:20.901028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:20.901708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:20.902153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:20.902572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:20.905711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=90 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:20.933345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-707f3b47-2ffa-4295-9527-29e6a23f82f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Sep 28 12:24:20.933903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 437/854] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:21.945790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:21.947897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:21.954425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:21.954899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:21.955325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:21.956005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:21.956483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:21.956901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:21.986248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e70f4ad3-dec7-4cde-ab63-54f9b50723c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Sep 28 12:24:21.986792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 418/855] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:22.998828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:23.001036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:23.007574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:23.008056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:23.008537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:23.009229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:23.009683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:23.010106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:23.039364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c70c7bec-2153-4e08-8f54-857b47401fe3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Sep 28 12:24:23.039913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 438/856] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:24.052035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:24.054152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:24.060470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:24.060947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:24.061376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:24.062060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:24.062507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:24.062923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:24.091127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-130a843c-95f7-44bd-8100-e2d5637b76e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Sep 28 12:24:24.091669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 419/857] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:25.102929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:25.105087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:25.111338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.111805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.112233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.112939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:25.113381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:25.113795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:25.142843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2eb69f62-b1b7-45a1-bb93-ae031e013707 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Sep 28 12:24:25.143389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 439/858] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:26.155532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:26.158308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:26.164528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:26.165009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:26.165449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:26.166140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:26.166588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:26.167014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:26.197262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1523dc8c-12a3-482f-a7d4-3470470c922c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046169 Sep 28 12:24:26.197812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 420/859] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:27.210428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:27.212593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:27.219071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.219548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.219987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.220701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:27.221156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:27.221575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:27.251102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e53c7a25-8561-4ca6-a82f-4061c7237b42 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 28 12:24:27.251658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 440/860] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:28.263879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:28.266041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:28.272454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:28.272934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:28.273367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:28.274054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:28.274501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:28.274926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:28.303794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bdc5ef8e-fa0f-44f0-834d-25d236206e75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Sep 28 12:24:28.304450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 421/861] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:29.316082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:29.318240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:29.325223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:29.325694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:29.326119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:29.326792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:29.327239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:29.327681 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:29.355711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-df92b72a-615c-444d-a614-8c99bd2ca9a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Sep 28 12:24:29.356252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 441/862] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:30.367787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:30.369963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:30.376557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:30.377040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:30.377499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:30.378190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:30.378640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:30.379062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:30.408002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1f999a3-7c51-4332-a1a0-f117de4ee407 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Sep 28 12:24:30.408575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 422/863] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:31.420066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:31.422214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:31.428529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:31.429003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:31.429485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:31.430189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:31.430634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:31.431049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:31.460258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-79c35bc9-b5ff-43da-b4a5-7f031864abd5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Sep 28 12:24:31.460883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 442/864] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:32.472599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:32.474687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:32.477136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:24:32.477280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:24:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments (ip 10.222.0.26) !!! Sep 28 12:24:32.485307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:32.485785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:32.486215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:32.486920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:32.487357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:32.487776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:32.518273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18afd954-75a6-469c-9e0e-f58d10e18ee4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049580 Sep 28 12:24:32.518828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 423/865] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:33.531136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:33.533365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:33.535412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:24:33.535558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments (ip 10.222.0.26) !!! Sep 28 12:24:33.544163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:33.544670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:33.545105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:33.545800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:33.546252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:33.546680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:33.576810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7834f811-c82f-4937-9ed2-a5f15a306fc7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049728 Sep 28 12:24:33.577364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 443/866] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:34.593238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:34.595399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:34.602852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:34.603337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:34.603799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:34.604523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:34.604972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:34.605402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:34.634665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b4d2a2d-b50e-44a5-8c7f-172195d5eaed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048541 Sep 28 12:24:34.635205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 424/867] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:35.647633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:35.649866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:35.657685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:35.658172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:35.658710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:35.659685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:35.660563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:35.661105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:35.691101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-68e42bac-c917-46da-bbf6-d731d203c2bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047608 Sep 28 12:24:35.691662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 444/868] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:36.703507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:36.705695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:36.711967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:36.712496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:36.712930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:36.713619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:36.714066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:36.714486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:36.742897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5bba685-8320-41b7-88e4-7d6049ceb1f2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Sep 28 12:24:36.743445 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 425/869] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:37.755660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:37.757965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:37.765233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:37.765706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:37.766136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:37.766817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:37.767261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:37.767676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:37.796157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fc616ab2-9ce7-419b-8ff0-5c06e8fce074 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Sep 28 12:24:37.796808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 445/870] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:38.808444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:38.810566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:38.817068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:38.817547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:38.817980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:38.818671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:38.819127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:38.819548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:38.849849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d2ab3ff-7e51-437d-9dd6-25075b922efa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Sep 28 12:24:38.850328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 426/871] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:39.862242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:39.864427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:39.870792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:39.871766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:39.872194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:39.872898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:39.873350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:39.873766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:39.902411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-baef2f45-c514-4f5a-a7c9-b8cf7d556e04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Sep 28 12:24:39.902952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 446/872] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:40.914827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:40.916991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:40.923809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:40.924286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:40.924755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:40.925438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:40.925888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:40.926313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:40.954933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3996cb6b-d1cb-4cfe-ac38-bec48d281067 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Sep 28 12:24:40.955490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 427/873] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:41.967116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:41.969340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:41.975644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:41.976121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:41.976856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:41.977540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:41.977988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:41.978405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:42.008252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-60a0636b-dbff-4480-a42c-6f9d98ae381f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Sep 28 12:24:42.008899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 447/874] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:43.022834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:43.024977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:43.032125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:43.032646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:43.033074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:43.033749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:43.034195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:43.034615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:43.062641 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79a1a855-b9f3-49bb-8e48-34e10d649c35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043637 Sep 28 12:24:43.063216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 428/875] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:44.074846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:44.077014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:44.083522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:44.084000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:44.084462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:44.085147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:44.085593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:44.086018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:44.114955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-098842c9-eaca-4f20-9dcb-baf9d5e93071 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Sep 28 12:24:44.115500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 448/876] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:45.127000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:45.129188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:45.135411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:45.135886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:45.136343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:45.137008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:45.137452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:45.137869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:45.167142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0d86b66e-cbda-4627-ab10-36fa20447fa7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Sep 28 12:24:45.167699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 429/877] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:46.180324 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:46.182508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:46.188928 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:46.189403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:46.189834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:46.190520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:46.190974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:46.191397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:46.220834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8ac5b623-b51c-49f9-bd4d-7010c0eb147d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Sep 28 12:24:46.221383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 449/878] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:47.232392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:47.234509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:47.240994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:47.241482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:47.241907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:47.242924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:47.243029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:47.243424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:47.273109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65725771-dce5-4a00-a46b-afdfd8c3862c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Sep 28 12:24:47.273681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 430/879] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:48.018629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:48.019847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:48.026391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.026877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.028066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.028796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.029250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.029677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.056794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:24:48.137032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d443c04e-2e7e-4a3d-85c7-62ea82cabebe tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 204 len: 0 microversion: 2.20 time: 0.121885 Sep 28 12:24:48.137833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 450/880] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 28 12:24:48 2022] DELETE /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:24:48.145944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:48.146557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:48.153065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.153773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.154192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.155236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.155775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.156105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.285956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:48.288346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:48.292764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:48.294279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.294756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.295367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.296071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:48.296694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:48.297280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:48.302223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:48.303717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:48.305451 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d1eb21b-18a6-496d-a1c5-eecfa35f284f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1723 microversion: 2.20 time: 0.163087 Sep 28 12:24:48.306541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 431/881] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:48 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:24:48.328078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f036d375-f05b-420e-b54d-26a2cd897f22 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046503 Sep 28 12:24:48.328676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 451/882] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:49.330991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:49.331599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:49.338187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.338663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.339097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.339802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.340253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.340471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:49.340877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.342575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:49.349061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.349541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.350157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.350863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.351314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.351993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.369725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:49.385597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-07a106e5-15b8-4e79-b6d1-587494d92756 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049100 Sep 28 12:24:49.386355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 452/883] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:49.527847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:49.536099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:49.537558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:49.538713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3a3bbac6-5790-499f-bfdb-ddad2c1205ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1723 microversion: 2.20 time: 0.211625 Sep 28 12:24:49.539268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 432/884] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:49 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:49.899147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "300ee327-113a-408e-8cee-099a7cc2a0ee", "name": "network-vif-deleted", "tag": "6d023a29-0ce0-422c-af0f-9f34e992320e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:49.913552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:49.914409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:49.914944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:49.928732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] Creating event network-vif-deleted:6d023a29-0ce0-422c-af0f-9f34e992320e for instance 300ee327-113a-408e-8cee-099a7cc2a0ee on hv-cinder-85919 Sep 28 12:24:49.934760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-0c66a1ac-a595-4d1e-ac43-8690f235cf65 req-5c864fb6-2997-4bcf-b958-4fe0a2bc6b64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039100 Sep 28 12:24:49.935712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 453/885] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:50.398268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:50.401109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:50.407082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=32 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:50.409459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:50.410231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:50.410828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:50.411700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:50.412296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:50.412894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:50.435137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=96 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:50.446209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b606b2a-1fdf-4db4-887c-0c038b5ea02b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051878 Sep 28 12:24:50.446777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 433/886] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:50.570194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:50.572255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:50.584060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:50.584775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:50.585401 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:50.586313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:50.586937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:50.587523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:50.628034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:50.630213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:50.631154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:50.631808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lazy-loading 'fault' on Instance uuid 300ee327-113a-408e-8cee-099a7cc2a0ee {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:24:50.961591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:50.972126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:50.974640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:50.976246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-554bee73-4be0-4aea-bead-8249286c1c0f tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 200 len: 1371 microversion: 2.20 time: 0.413969 Sep 28 12:24:50.977712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 454/887] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:50 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:51.459504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:51.461761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:51.468945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.469502 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.470009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.471089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:51.471611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:51.472109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:51.504181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b078511-58bb-4745-8db3-de43434f6587 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048923 Sep 28 12:24:51.504841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 434/888] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:52.004648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:52.005401 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:52.007940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:24:52.014292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.014856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.015357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.016505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.017038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.017531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.035313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee HTTP/1.1 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:24:52.037005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:24:52.038545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '300ee327-113a-408e-8cee-099a7cc2a0ee'} Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:24:52.039374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:24:52.040720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:24:52.041841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:24:52.041841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cfe928b2-6e64-445b-93dd-3cfb89d16045 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 404 len: 111 microversion: 2.20 time: 0.037982 Sep 28 12:24:52.041841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 455/889] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:51 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:24:52.047328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38d0a11c-406a-440d-bee0-ec5ee858c414 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '.version_select at 0x7f306263a820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:52.071737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38d0a11c-406a-440d-bee0-ec5ee858c414 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266835590" status: 204 len: 0 microversion: 2.20 time: 0.028141 Sep 28 12:24:52.072330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 435/890] 10.222.0.26 () {60 vars in 1259 bytes} [Wed Sep 28 12:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266835590 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 28 12:24:52.516669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:52.518986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:52.525507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.526005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.526443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.527830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:52.528286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:52.528757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:52.561592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fa3b1f42-624f-4a2b-b746-9aa1ef3f3be3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047829 Sep 28 12:24:52.562514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 456/891] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:52.934163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39ec6d47-a2ad-4f54-b00b-814891fa76ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Action: 'create', calling method: .version_select at 0x7f30625a7d30>, body: {"keypair": {"name": "tempest-keypair-1661700684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxrVzdzKhdkM691Yuuq47ttvcluaMav8LTKIK8DVvRex7WGQ8N/dlVAqVF2u9KTtnZdf2dFL9iGNbOGyucz6yUxhRnhJsviuLyF+FCKZjnOvoydx2GTpfTld6dNDgHR8Q=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:52.950648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-39ec6d47-a2ad-4f54-b00b-814891fa76ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for project ba288a6bdc4e41729bd679733eaee61e. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:52.954654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-39ec6d47-a2ad-4f54-b00b-814891fa76ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for user 820f4bb963644499a77fa1f3edd59d08 and project ba288a6bdc4e41729bd679733eaee61e. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:52.977053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39ec6d47-a2ad-4f54-b00b-814891fa76ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047064 Sep 28 12:24:52.977651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 436/892] 10.222.0.26 () {62 vars in 1200 bytes} [Wed Sep 28 12:24:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 12:24:53.575726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:53.578013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:53.584649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:53.585079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:53.585519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:53.586221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:53.586682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:53.587113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:53.619609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-15aedaa5-d154-49fb-8798-252a7174ee71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048751 Sep 28 12:24:53.624746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 457/893] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:54.206058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-855834891", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0a9dafc-fc91-423a-8269-e35c8e5ecc91"}], "security_groups": [{"name": "tempest-securitygroup--2062406939"}], "key_name": "tempest-keypair-1661700684", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:54.313655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] validate_networks() for [('f0a9dafc-fc91-423a-8269-e35c8e5ecc91', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:24:54.632925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:54.635364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:54.643305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.644138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.644817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.645743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.646632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.647274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.678314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4958a4ea-89c0-4b53-91f5-98a445081906 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Sep 28 12:24:54.678883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 458/894] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:54.734315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:24:54.734752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:24:54.735229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:24:54.735640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:24:54.736055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:24:54.746133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.746610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.747049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.747770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:54.748225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:54.748678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:54.765317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for project ba288a6bdc4e41729bd679733eaee61e. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:24:54.769299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Getting quotas for user 820f4bb963644499a77fa1f3edd59d08 and project ba288a6bdc4e41729bd679733eaee61e. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:24:54.780892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:24:54.783176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:24:54.830290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21228875-cb81-461f-b0c4-b69ba0e11801 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.629047 Sep 28 12:24:54.830944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 437/895] 10.222.0.26 () {62 vars in 1188 bytes} [Wed Sep 28 12:24:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 12:24:54.842597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:54.843311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:54.896823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:54.904659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:54.906100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:54.907210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a07874c3-6bbc-4ee6-8e30-d3f9ec4571ae tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1281 microversion: 2.20 time: 0.069142 Sep 28 12:24:54.907771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 459/896] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:54 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:55.690491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:55.692926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:55.702430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.702957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.704160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.705121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.705777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.706565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.740732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-284328a1-002c-4d38-b8c5-1a63120d9d3b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054007 Sep 28 12:24:55.744507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 438/897] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:55.932571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:55.933113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:55.941219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.941699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.942135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:55.942822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:55.943276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:55.943703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.005057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:56.013549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:56.015038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:56.016156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d0ede71d-a753-4b8b-9aa0-5ceedf041bc9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1333 microversion: 2.20 time: 0.087640 Sep 28 12:24:56.016761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 460/898] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:55 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:56.756199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:56.775040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:56.788173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.788767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.789493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.790221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:56.790683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:56.791117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:56.830403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-550edbe2-38c1-491d-a0ea-c492593665f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080992 Sep 28 12:24:56.831132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 439/899] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:57.041328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:57.048287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:57.055165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.055864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.056321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.058050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.058050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.058050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.189839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:57.198256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:57.200413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:57.201617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-958ceb68-9c9b-446f-b625-ce87402d43e1 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.164245 Sep 28 12:24:57.202261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 461/900] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:57 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:57.772547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6193f7a3-88d5-468f-ab3c-6e94ce08555e", "tag": "c8f8ac1e-9e76-4e98-84c1-a77ee8423ded"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:24:57.784747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.785316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.785981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.798265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] Creating event network-changed:c8f8ac1e-9e76-4e98-84c1-a77ee8423ded for instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e on hv-cinder-85919 Sep 28 12:24:57.813174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-29ea7dda-a11c-4a51-83a1-135f271123c4 req-a481b177-a453-4823-ac7a-fe37da578b2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045098 Sep 28 12:24:57.814401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 440/901] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:24:57.847217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:57.850668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:57.857366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:57.858035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:57.858161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.858526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.859374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.860819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.861477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.862098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.865221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.865787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.866428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.867200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.869581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.870121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.898114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:24:57.898951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b45e7df1-6a00-45d1-be51-97c17f249a15 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059793 Sep 28 12:24:57.899568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 462/902] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:57.973712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8939f248-7688-4e02-8063-59917e932254 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 204 len: 0 microversion: 2.1 time: 0.121905 Sep 28 12:24:57.974828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 441/903] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:24:57 2022] DELETE /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:24:57.984335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:57.984603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:57.990549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.991035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.991472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:57.992166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:57.992662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:57.993087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.121976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.130308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-24cff2b5-2f6a-4acb-a1ea-a3c103e00f26 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1671 microversion: 2.1 time: 0.151001 Sep 28 12:24:58.130885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 463/904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:57 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:24:58.227255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:58.227867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:58.233851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.234328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.234756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.236229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.236767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.237673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.373397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.381433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.383295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:58.384542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17ca040f-1197-457a-a4a4-4cd83a2b59c9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.161792 Sep 28 12:24:58.385123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 442/905] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:58 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:58.911004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:58.913255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:58.919255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.919736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.920171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.920902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:58.921355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:58.921772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:58.951135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a8012987-0527-4954-a1cb-8233b89cb1aa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Sep 28 12:24:58.951680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 464/906] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:24:59.154972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:59.155571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:59.162010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.162490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.162926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.163611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.164068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.164539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.293836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:59.301483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b932c629-81c3-460a-a20a-e8c57c4822a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1671 microversion: 2.1 time: 0.151004 Sep 28 12:24:59.302049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 443/907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:24:59 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:24:59.409444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:59.409988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:59.416346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.417081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.417533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.418220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.418676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.419098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.547151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:59.555166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:59.556631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:24:59.557734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-207aa817-4c97-4d06-b982-fbabea6be1cc tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.152193 Sep 28 12:24:59.558318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 465/908] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:24:59 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:24:59.963103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:24:59.966049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:24:59.971902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.972425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.972866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:24:59.973576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:24:59.974024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:24:59.974448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.004699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-50ffd75d-bcd4-4256-965b-7b78e320c9e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Sep 28 12:25:00.005253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 444/909] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:24:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:00.325976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:00.326697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:00.332676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.333148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.333577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.334254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.334698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.335117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.461947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:00.470185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eb960d11-45b7-44ce-839e-65231f1c84e2 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1671 microversion: 2.1 time: 0.148621 Sep 28 12:25:00.470749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 466/910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:00 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:00.651333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:00.652019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:00.658496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.658972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.659401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.660150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:00.660645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:00.661068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:00.923075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:00.931063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:00.932843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:00.934459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1e64bc9b-dadb-4ddc-8bd5-8a7c6d35006b tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.355253 Sep 28 12:25:00.935015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 445/911] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:00 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:25:01.019564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.022224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.032356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.032846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.034374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.034855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.035279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.036702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.037155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.037574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.063321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.063821 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.064242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.064970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.065415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.065832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.092416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:25:01.097237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8d6a1ba9-0348-4b58-9a7b-033716306306 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083018 Sep 28 12:25:01.100733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 467/912] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:01.171269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62526adb-eca9-4ae9-b54b-5634a856bbc9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 204 len: 0 microversion: 2.1 time: 0.144789 Sep 28 12:25:01.175911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 446/913] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:25:01 2022] DELETE /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:25:01.181531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.182145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.189812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.190301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.190735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.191654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.192106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.192731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.325895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:01.333576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fcd90071-c14a-4629-9b52-7cb20af18ba9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1680 microversion: 2.1 time: 0.156316 Sep 28 12:25:01.334140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 468/914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:01.500827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.501566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.510816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.511330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.511746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.512522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.512991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.513422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.764945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:01.772777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dd32acd6-f2e7-4cca-9c56-eaa57d878ab4 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1671 microversion: 2.1 time: 0.277979 Sep 28 12:25:01.773356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 447/915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1671 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:01.964570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:01.965880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:01.973234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.974059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.974676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:01.975658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:01.976717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:01.977788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.114272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.117093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.133176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.133680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.134124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.134849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.152672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.157033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.225497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-34ec96a2-5313-4364-b8a7-212639a95e30 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115915 Sep 28 12:25:02.226669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 448/916] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:02.233861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dafad59-8746-4b43-9873-444b28b0da27", "name": "network-vif-deleted", "tag": "5d5dc8e7-99bd-40f3-8aca-1ca4833608cf"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:02.236246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.245646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.246475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.247095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.257224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.259464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.260857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-289f7458-55c2-4149-9808-90cd9279a860 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.304237 Sep 28 12:25:02.262338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 469/917] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:01 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:25:02.266866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] Creating event network-vif-deleted:5d5dc8e7-99bd-40f3-8aca-1ca4833608cf for instance 7dafad59-8746-4b43-9873-444b28b0da27 on hv-cinder-85919 Sep 28 12:25:02.285856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ad36a5e5-8691-4130-be0c-5958721c43f4 req-5d1147fb-82a8-4330-b417-d572bd351f14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054166 Sep 28 12:25:02.287269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 449/918] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:02.359488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.360484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.378196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.380970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.381745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.383846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.385412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.387541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.577310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.579499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:02.587596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4fce9223-ea18-417b-ae1f-c5dfd835a5a8 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1680 microversion: 2.1 time: 0.234119 Sep 28 12:25:02.588528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 470/919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:02.798138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:02.800029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:02.809584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.810225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.810671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.811384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.811846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.812277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.830604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:02.859569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:02.860059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:02.860555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:02.860997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lazy-loading 'fault' on Instance uuid 7dafad59-8746-4b43-9873-444b28b0da27 {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:25:02.933881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:02.950200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c58c4bff-7934-429c-9c58-cec38753c33d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 200 len: 1326 microversion: 2.1 time: 0.156620 Sep 28 12:25:02.966154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 450/920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:02 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:03.239760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:03.243719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:03.253822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.254805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.255571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.256699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.257378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.258074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.291320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:03.292041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:03.304760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.307640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.308603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.309583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.312621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.313319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.350020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b02e86a-1c72-4549-9d05-9604b066b13e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110339 Sep 28 12:25:03.350854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 471/921] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:03.487647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.496386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.497751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.499127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4bce6485-9fa0-49fd-bcfa-f8237166edab tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.214414 Sep 28 12:25:03.500384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 451/922] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:03 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:25:03.610870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:03.611479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:03.617295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.618020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.618667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.619580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.620273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.620965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.654833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:03.655320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:03.655765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:03.656226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lazy-loading 'fault' on Instance uuid 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:25:03.696723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:03.705519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6719e389-78be-4107-8342-7520d7d6d455 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 200 len: 1331 microversion: 2.1 time: 0.098417 Sep 28 12:25:03.714622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 472/923] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:03 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:03.981901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:03.982513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.000813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.001351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.001813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.002558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.003075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.003501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.019356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 HTTP/1.1 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:25:04.021240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:25:04.022594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '7dafad59-8746-4b43-9873-444b28b0da27'} Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:25:04.023388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:25:04.024651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.025920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:25:04.025920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4e091aa8-90f2-4060-ab0c-e693d723b6fe tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 404 len: 111 microversion: 2.1 time: 0.047336 Sep 28 12:25:04.027159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 452/924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:03 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:25:04.032562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-137dcff5-46e4-4f8e-aa98-7d1eb4b7d3fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '.version_select at 0x7f306245b700>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.081550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-137dcff5-46e4-4f8e-aa98-7d1eb4b7d3fb tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976601085" status: 202 len: 0 microversion: 2.1 time: 0.053541 Sep 28 12:25:04.086891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 473/925] 10.222.0.26 () {58 vars in 1218 bytes} [Wed Sep 28 12:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976601085 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:25:04.288052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6193f7a3-88d5-468f-ab3c-6e94ce08555e", "name": "network-vif-plugged", "status": "completed", "tag": "c8f8ac1e-9e76-4e98-84c1-a77ee8423ded"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:04.313358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.314108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.314700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.344433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9", "name": "network-vif-deleted", "tag": "cc0af34f-a04e-4ebc-b617-e2310dc4c9c6"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:04.346514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] Creating event network-vif-plugged:c8f8ac1e-9e76-4e98-84c1-a77ee8423ded for instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e on hv-cinder-85919 Sep 28 12:25:04.354725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4caec268-4a1f-4add-9275-5ac16d83360a req-4b75c349-2151-467c-8a3e-cbf5c17cddbe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159056 Sep 28 12:25:04.355861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 453/926] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:04.365494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.368012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.368625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.369409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.373259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.376053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.376654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.377161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.378180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.378715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.379703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.400053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] Creating event network-vif-deleted:cc0af34f-a04e-4ebc-b617-e2310dc4c9c6 for instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 on hv-cinder-85919 Sep 28 12:25:04.417011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-9a6796a9-cad0-441f-9bf2-185e8e5c0edc req-b9c38bc5-118d-4456-8cac-b058b5412cf7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078277 Sep 28 12:25:04.418900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 474/927] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:04.425636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2b2a964-e208-429d-be5a-973a541bdd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064425 Sep 28 12:25:04.426655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 454/928] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:04.527523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.528346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.539639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.540137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.540605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.541351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.541800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.542221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.681712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.690077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.691519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:04.693330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2aed2025-8ec8-4a06-9d46-1d9a110c6817 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.171130 Sep 28 12:25:04.693903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 475/929] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:25:04.731249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.731964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:04.737911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.738414 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.738907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.739663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:04.740180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:04.740920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:04.755723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:04.757776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 HTTP/1.1 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:25:04.759400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:25:04.761124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9'} Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:25:04.765752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:25:04.767077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:25:04.768481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:25:04.768481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fdb8664-d9ca-4397-a91f-045a1493f41a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 404 len: 111 microversion: 2.1 time: 0.034316 Sep 28 12:25:04.768481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 455/930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:04 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 12:25:04.770448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0ce2d7c2-7053-4516-aacd-f1be8ba33e62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '.version_select at 0x7f306245bb80>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:04.790235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0ce2d7c2-7053-4516-aacd-f1be8ba33e62 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031298439" status: 202 len: 0 microversion: 2.1 time: 0.023626 Sep 28 12:25:04.790814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 476/931] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 28 12:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031298439 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:25:05.248545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93bbc1c0-a450-48aa-9c3d-6c7c5919c804 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Action: 'create', calling method: .version_select at 0x7f306259f820>, body: {"keypair": {"name": "tempest-keypair-1779020517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqKmW2GKJfiBDVgbdZuNUX2E/4zaSpYcfIqxGhhK7/lYiIrJaDcW71WzHc9qmPPQ8+88kkgPtOExiPerGzLGQTSM60Yb64wNBNxo4P5as6xa1uRq0DmZYQSyycprKicBg=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:05.254099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:05.266186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-93bbc1c0-a450-48aa-9c3d-6c7c5919c804 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:05.269969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-93bbc1c0-a450-48aa-9c3d-6c7c5919c804 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for user fdb0f345d2e04483b5166e1eb728bf91 and project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:05.294404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93bbc1c0-a450-48aa-9c3d-6c7c5919c804 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050473 Sep 28 12:25:05.295296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 456/932] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:25:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:05.435239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:05.440390 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:05.442495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:05.451754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.452727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.453279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.454093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.454551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.454977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.501721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dd38d123-050e-4cab-b487-9122d618dc5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067153 Sep 28 12:25:05.502355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 477/933] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:05.549534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5dcbfbd1-7d5a-4b72-b77d-2da6e9c1cfab tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: .version_select at 0x7f30625a74c0>, body: {"keypair": {"name": "tempest-keypair-1789933383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzCZkfT1P7yqp0B4e9MKQzXi6Ij7+8SbwCJKJh1kQ2FIZLHrmeo9yUeiImMIKNZo/G1mJLL0S4XmYa2qZpcuXCEiEiq+nFxO78wwIooYdOulV0DV5HTox0oG5biS0lX9A=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:05.557381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:05.582383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5dcbfbd1-7d5a-4b72-b77d-2da6e9c1cfab tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:05.587307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-5dcbfbd1-7d5a-4b72-b77d-2da6e9c1cfab tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:05.610709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5dcbfbd1-7d5a-4b72-b77d-2da6e9c1cfab tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065147 Sep 28 12:25:05.611310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 457/934] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:25:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:05.721315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:05.723048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:05.732762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.733696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.734449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.735962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:05.737416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:05.738780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:05.935323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:05.953575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:05.956623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:05.957750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-96b2b6ae-85f0-42f2-a688-ec3067ae6537 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1407 microversion: 2.20 time: 0.241850 Sep 28 12:25:05.966416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 478/935] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:05 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 12:25:06.515134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:06.518001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:06.527164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.527634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.528193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.528974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.529619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.530036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.568887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c5ef996-aa78-4269-a2d7-2fa0f8b8cf04 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059124 Sep 28 12:25:06.569812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 458/936] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:06.899770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-617941152", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35d98253-7d06-4089-91c8-50499176172f"}], "security_groups": [{"name": "tempest-securitygroup--446569846"}], "key_name": "tempest-keypair-1779020517", "user_data": "}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:06.984236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:06.988539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:06.991813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.992342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.992837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:06.994052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:06.994601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:06.995393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.007869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] validate_networks() for [('35d98253-7d06-4089-91c8-50499176172f', None, None, None, None, None)] {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:25:07.132546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.140836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.142293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.143427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9dca3fe-6b94-45d2-8908-c8f933e4c9a9 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1599 microversion: 2.20 time: 0.164209 Sep 28 12:25:07.143983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 459/937] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:25:06 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:25:07.155188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-303710320", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61173ad2-9eff-4ab1-9b46-07b6bca945cf"}], "security_groups": [{"name": "tempest-securitygroup--1035494625"}], "key_name": "tempest-keypair-1789933383", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:07.267389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] validate_networks() for [('61173ad2-9eff-4ab1-9b46-07b6bca945cf', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:25:07.437509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:25:07.437931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:25:07.438429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:25:07.438836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:25:07.439247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:25:07.448141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.448691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.449131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.449860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.450313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.450776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.468132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:07.472190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Getting quotas for user fdb0f345d2e04483b5166e1eb728bf91 and project f7f6e096c5a54a7ebc843b012e82e0f4. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:07.485844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:25:07.488174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:25:07.539129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-12ec3418-40fc-48b0-b592-6f6832971c18 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644581 Sep 28 12:25:07.543055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 479/938] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:25:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:25:07.549110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.549835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.558132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.558831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.559675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.560411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.561059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.561682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.648149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b59780d3-025d-4cf8-8f52-240693e2f18a tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103748 Sep 28 12:25:07.648781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 480/939] 10.222.0.26 () {60 vars in 1316 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:25:07.654195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a2e25cb3-f7a4-4823-bc65-69e2f4b4f284 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.654803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a2e25cb3-f7a4-4823-bc65-69e2f4b4f284 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.687626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:25:07.688169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:25:07.688548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:25:07.688958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:25:07.689370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:25:07.698745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.699184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.699659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.700504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.700991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.701450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.722874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:25:07.727654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:25:07.740662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:25:07.743113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:25:07.763851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a2e25cb3-f7a4-4823-bc65-69e2f4b4f284 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.771837 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a2e25cb3-f7a4-4823-bc65-69e2f4b4f284 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1237 microversion: 2.1 time: 0.121708 Sep 28 12:25:07.772741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 481/940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:07.782534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.786347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.796450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.797053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.798450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.799168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:07.799622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:07.800047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:07.805547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e8447a5a-0638-4a36-b284-c7a8936b4362 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660497 Sep 28 12:25:07.812630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 460/941] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:25:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:25:07.818432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc892d13-f48c-49cc-9406-31dbb0a48618 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:07.819276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc892d13-f48c-49cc-9406-31dbb0a48618 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:07.872956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-930f8159-f547-4f75-935d-97ceaf161130 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099141 Sep 28 12:25:07.874275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 482/942] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:07.883977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc892d13-f48c-49cc-9406-31dbb0a48618 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:07.894287 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc892d13-f48c-49cc-9406-31dbb0a48618 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1241 microversion: 2.1 time: 0.079880 Sep 28 12:25:07.896716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 461/943] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:07 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:08.796333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:08.797044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:08.804741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.805558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.806311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.807390 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.808804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.810499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.893780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:08.907667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:08.926047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.926906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.928477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.929477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:08.930096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:08.930678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:08.985979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70d029a2-4df2-40dd-84ee-f71d798d28e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103682 Sep 28 12:25:08.993019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 462/944] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:08.999193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:09.001147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:09.014980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.015449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.015881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.017091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.018431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.019002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.028327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:09.037170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6f770ab7-695f-459b-9f02-711f4aa9c491 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1297 microversion: 2.1 time: 0.245814 Sep 28 12:25:09.041122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 483/945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1297 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:09.111857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6193f7a3-88d5-468f-ab3c-6e94ce08555e", "tag": "c8f8ac1e-9e76-4e98-84c1-a77ee8423ded"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:09.121737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:09.122448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:09.123035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:09.134721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] Creating event network-changed:c8f8ac1e-9e76-4e98-84c1-a77ee8423ded for instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e on hv-cinder-85919 Sep 28 12:25:09.140680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-e0041a3f-6452-433d-9a00-026d939f99bf req-147ee4d2-7beb-4002-8ee4-b07c14ea0a2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 Sep 28 12:25:09.141366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 484/946] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:09.167175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:09.176073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c65a46a-451b-4421-979c-52e481e4672a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1293 microversion: 2.1 time: 0.181474 Sep 28 12:25:09.185453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 463/947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:08 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:10.000970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.003507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.015649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.018470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.019253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.021968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.024049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.024540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.066916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.067558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.079500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.079928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.080838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.081081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.084518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.085147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.092605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d452b1c1-0aff-42aa-9b57-ccca0a7f9d43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096961 Sep 28 12:25:10.096238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 485/948] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:10.204257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:10.211372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:10.221124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.221894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.222687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.224414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:10.224965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:10.225598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:10.326091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:10.342024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a47f58c3-33bc-4ea0-898f-31473dcf6648 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1299 microversion: 2.1 time: 0.141589 Sep 28 12:25:10.343725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 486/949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:10 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:10.532617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:10.542619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-315247f4-d90b-4398-9ce1-9a33dff6b724 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.483241 Sep 28 12:25:10.544732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 464/950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:10 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:11.088709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dc44e-ec85-4db2-8d42-c203c19a303c", "tag": "bb5a5d14-ba0b-4795-868c-3c70d3662556"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:11.108229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:11.114348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:11.122778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.123310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.123785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.128402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.129178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.130090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.131073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.131759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.132576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.137672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] Creating event network-changed:bb5a5d14-ba0b-4795-868c-3c70d3662556 for instance 556dc44e-ec85-4db2-8d42-c203c19a303c on hv-cinder-85919 Sep 28 12:25:11.142642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-441b28ae-2edb-41c2-9d95-a640593d5bd3 req-50dc04f1-504c-419d-9d1a-2f95e4b78378 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062182 Sep 28 12:25:11.143252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 487/951] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:11.175251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0585a709-2f17-44da-b311-8c86803984a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073222 Sep 28 12:25:11.175632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 465/952] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:11.301555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97720b27-58c6-4839-af0c-7c669c4b841d", "tag": "81df7b9b-fe09-416e-a329-f2f48b35d24e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:11.314414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.315033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.315697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.331336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] Creating event network-changed:81df7b9b-fe09-416e-a329-f2f48b35d24e for instance 97720b27-58c6-4839-af0c-7c669c4b841d on hv-cinder-85919 Sep 28 12:25:11.339539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-aa1d71bf-9737-4157-a0f8-a471e1e452af req-73391378-f9b0-439c-8f6b-02e1db98fa67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042343 Sep 28 12:25:11.340608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 488/953] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:11.367831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:11.368398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:11.381739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.382268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.384473 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.385488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.388880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.390762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.570120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:11.571357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:11.579698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.580183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.580812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.581509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:11.581961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:11.582402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:11.644420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:11.654643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-95bfb16a-cdba-4c45-82ce-eb6efcab084b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.291901 Sep 28 12:25:11.655533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 466/954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:11 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:11.773813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:11.783039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c4b45f54-6dd9-4270-9ea7-fbd0899e2cf7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.217307 Sep 28 12:25:11.783745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 489/955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:11 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:12.187980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:12.190247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:12.196669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.197142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.197571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.198250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.199310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.199732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.228276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ff674b1-ce6e-4b0d-8478-612f27347e89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Sep 28 12:25:12.228849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 467/956] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:12.677882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:12.678486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:12.684935 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.685405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.685830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.686513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.686956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.687375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.806843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:12.807476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:12.813306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:12.814043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.814532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.814973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.815672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:12.816437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:12.816789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:12.820783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b4a39004-c255-4511-9a42-b5fd963e636c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.146614 Sep 28 12:25:12.821512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 490/957] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:12 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:12.946870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:12.954541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d33798c-758a-4af0-935b-99ec5ea0dea7 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.151825 Sep 28 12:25:12.955096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 468/958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:12 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:13.240726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.242856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.248748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.249220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.249650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.250321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.250767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.251186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.280633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-df7093a8-91a6-4286-aa7a-5f9cda1aca6b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Sep 28 12:25:13.281276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 491/959] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:13.843044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.843752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.850525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.850999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.851427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.852402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.852857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:13.853277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:13.984954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:13.985713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:13.993954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:13.998273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:13.999082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.000350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.001238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.001695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.002818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.146682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:14.155881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1ab3869-eb26-46cb-aa93-edd0f2774181 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.316548 Sep 28 12:25:14.156498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 469/960] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:14.168245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:14.176172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-706ac767-b91a-4ef7-9230-6bac20a7855a tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.201160 Sep 28 12:25:14.176866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 492/961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:13 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:14.293010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:14.295871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:14.302867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.303355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.303791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.304518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:14.304973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:14.305396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:14.335350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b66b7944-e4e7-4852-9763-63a491d40910 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Sep 28 12:25:14.335904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 470/962] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:15.179056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:15.179589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:15.186579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.187058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.187493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.188182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.188662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.189098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.199341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:15.199948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:15.206520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.206997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.207423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.208117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.208589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.209025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.322192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:15.324475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:15.331424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f5d9cf58-6418-46a9-8a4d-81d9bf08a1ed tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.156241 Sep 28 12:25:15.332019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 493/963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:15 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:15.347601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:15.349810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:15.356774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.357256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.357686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.358384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:15.358831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:15.359249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:15.390629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-83fcc68a-f49b-4e82-9a59-982ab811f6fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Sep 28 12:25:15.391236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 494/964] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:15.588888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:15.596653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1802dafb-f599-4fc8-8bb9-9670c7894410 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.401596 Sep 28 12:25:15.597211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 471/965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:15 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:16.175912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dc44e-ec85-4db2-8d42-c203c19a303c", "name": "network-vif-plugged", "status": "completed", "tag": "bb5a5d14-ba0b-4795-868c-3c70d3662556"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:16.186972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.187596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.187932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.201529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] Creating event network-vif-plugged:bb5a5d14-ba0b-4795-868c-3c70d3662556 for instance 556dc44e-ec85-4db2-8d42-c203c19a303c on hv-cinder-85919 Sep 28 12:25:16.206683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-b712608d-473a-4f90-a690-49e0563c63af req-667f0ecc-9ef2-4c5e-9823-c07fcaf9e05a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Sep 28 12:25:16.207498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 495/966] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:16.353903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.354535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.361508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.361988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.362423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.363113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.363567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.363994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.379280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:16.404092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.406338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.412391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.412867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.413296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.413983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.414440 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.414861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.443818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-527d2eee-c1f6-465d-b4e5-dccf421b58cf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 28 12:25:16.444402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 496/967] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:16.498264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:16.506711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82a20c65-7a57-4916-8e23-94bb3c059163 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.156831 Sep 28 12:25:16.519936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 472/968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:16.620236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:16.621188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:16.628476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.629770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.631001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.631878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:16.632601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:16.633679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:16.862275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:16.869919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ba20b425-a5e8-4683-9f7f-9fcad7e3c074 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.253680 Sep 28 12:25:16.871142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 497/969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:16 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:17.456421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.458470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.464930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.465401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.465830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.466512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.466959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.467380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.496458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8da76753-c547-4fc3-878c-03d715a569a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Sep 28 12:25:17.497022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 473/970] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:17.528912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.529522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.531934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:17.537398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.537882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.538314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.539007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.539459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.539884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.676516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:17.684911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d90182bd-854d-45c3-b8af-0bbe39d7d2e9 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.159755 Sep 28 12:25:17.685485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 498/971] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:17.893059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:17.893665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:17.895502 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:17.896205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=16 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:17.902815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.903288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.903719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:17.904430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:17.904880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:17.905301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.035359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:18.042973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dbef7eb9-c781-4dcf-86f9-70ddb7220591 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1362 microversion: 2.1 time: 0.153669 Sep 28 12:25:18.043527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 474/972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:17 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:18.508970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:18.511191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:18.513151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=8 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:18.518983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.519600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.520095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.520892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.521408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.521838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.551285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6f1d75a4-60c9-4f00-bc71-50b4b8054009 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Sep 28 12:25:18.551906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 499/973] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:18.708192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:18.709457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:18.716551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.717024 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.717449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.718135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:18.718577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:18.719188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:18.854468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:18.862247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8d483e5f-3a73-42fc-952d-e8149444378c tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.157996 Sep 28 12:25:18.862828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 475/974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:18 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:25:19.066677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.067236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.073215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.074202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.074632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.075320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.075770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.076194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.204615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:19.212238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b4d5c9a8-0392-4034-9108-2b9fe81548b0 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1549 microversion: 2.1 time: 0.149537 Sep 28 12:25:19.212865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 500/975] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:19.236884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.237380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.243264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.243740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.244170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.244876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.245354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.245772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.323046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-931b5795-8146-42e3-bdb1-d2dd2ce48cec tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089961 Sep 28 12:25:19.324148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 476/976] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:19.563666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.565967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.572333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.572997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.574049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.574787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.575240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.575665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.604735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b65810b8-be72-48fa-ab8d-2f96f0e3d349 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 28 12:25:19.605307 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 501/977] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:19.885790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:19.886446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:19.892371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.892861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.893467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:19.894157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:19.894795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:19.895217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.045955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:20.053587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ce32ea3-3c8e-4b27-aea6-44087bd90c5f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.172007 Sep 28 12:25:20.054149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 477/978] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:19 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:20.247644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97720b27-58c6-4839-af0c-7c669c4b841d", "name": "network-vif-plugged", "status": "completed", "tag": "81df7b9b-fe09-416e-a329-f2f48b35d24e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:20.253791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556dc44e-ec85-4db2-8d42-c203c19a303c", "tag": "bb5a5d14-ba0b-4795-868c-3c70d3662556"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:20.261577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.262135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.262687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.263324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.263790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.264214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.274538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] Creating event network-vif-plugged:81df7b9b-fe09-416e-a329-f2f48b35d24e for instance 97720b27-58c6-4839-af0c-7c669c4b841d on hv-cinder-85919 Sep 28 12:25:20.277594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] Creating event network-changed:bb5a5d14-ba0b-4795-868c-3c70d3662556 for instance 556dc44e-ec85-4db2-8d42-c203c19a303c on hv-cinder-85919 Sep 28 12:25:20.282154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-3b091af2-5b5e-485b-95cf-e69592320fbf req-340e4a66-0347-45e0-90a5-80609927f58f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040244 Sep 28 12:25:20.282927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-4656bb85-dbd8-4277-b192-449a54eeb133 req-2106039d-43d5-4678-8f80-7db7c94a02b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Sep 28 12:25:20.283334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 502/979] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:20.283764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 478/980] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:20.618513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:20.621912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:20.630085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.630872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.631473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.632423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:20.633051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:20.633636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:20.680118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3a4cb8c8-9e6e-4c43-87f0-8984a7a1867d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066169 Sep 28 12:25:20.681588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 503/981] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:21.082172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:21.083552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:21.090776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.091254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.091681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.092476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.092925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.093515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.230958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:21.239567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ac8e503-19ba-45fe-a5e8-d5977c256a8d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.161204 Sep 28 12:25:21.240151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 479/982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:21 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:21.693068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:21.695398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:21.702510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.702926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.703358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.704052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:21.704656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:21.705080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:21.733908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-88a19c71-7f44-4ae5-991d-dd854a25398b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Sep 28 12:25:21.734474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 504/983] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:22.262535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:22.263042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:22.269552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.270028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.270457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.271141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.271587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.272004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.404634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:22.412327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7dacc9aa-77ab-46e7-913f-d368641ec0c6 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1367 microversion: 2.1 time: 0.153632 Sep 28 12:25:22.412892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 480/984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:22 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:22.746319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:22.748534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:22.754958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.755435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.755869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.756648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:22.757098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:22.757520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:22.786994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bf7ef5e7-a374-4001-81db-1992f51b6e5d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 28 12:25:22.787543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 505/985] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:23.435334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:23.435940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:23.444114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.444636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.445104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.446176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.446663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.447095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.575734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:25:23.583500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddfe7401-2772-443e-9c2b-e5d5ca8ca47a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1558 microversion: 2.1 time: 0.152510 Sep 28 12:25:23.584068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 481/986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:25:23 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:25:23.606375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:23.606888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:23.612815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.613294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.613725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.614466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.614945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.615370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.694551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fda114f9-2029-4809-a6a0-ca15f4fad55e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092350 Sep 28 12:25:23.695154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 506/987] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 28 12:25:23 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:23.799143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:23.801364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:23.807207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.807680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.808112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.808824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:23.809271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:23.809691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:23.838566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bd94c7d0-ac1c-4d61-9e9f-84b431100f6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Sep 28 12:25:23.839735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 482/988] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:24.618944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97720b27-58c6-4839-af0c-7c669c4b841d", "tag": "81df7b9b-fe09-416e-a329-f2f48b35d24e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:25:24.629493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.629973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.630402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.642434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] Creating event network-changed:81df7b9b-fe09-416e-a329-f2f48b35d24e for instance 97720b27-58c6-4839-af0c-7c669c4b841d on hv-cinder-85919 Sep 28 12:25:24.647498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-52ea0638-836c-4cff-9b7c-da12a22d62d5 req-15812d56-98d7-444a-9870-6b9493cc87b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032710 Sep 28 12:25:24.648186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 507/989] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:24.851459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:24.853846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:24.860820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.861544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.861980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.862691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:24.863151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:24.863569 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:24.893233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b44c03df-6171-4746-8e00-26bf52c07175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Sep 28 12:25:24.894022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 483/990] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:25.907273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:25.909506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:25.915617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.916092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.916562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.917757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:25.918205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:25.918634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:25.947510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e944425c-e900-488f-aead-78bb8f845151 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Sep 28 12:25:25.948065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 508/991] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:26.959813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:26.961989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:26.968739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.969213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.969643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.970320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:26.970767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:26.971181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:26.999949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ebf8313-bb48-4199-957f-52c5897f3c79 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Sep 28 12:25:27.000508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 484/992] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:28.013010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:28.015114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:28.021779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.022260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.022702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.023395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:28.023849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:28.024275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:28.056187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-78f5ca8d-cb9c-4646-958a-d7a6f1a2b413 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047868 Sep 28 12:25:28.056786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 509/993] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:29.069509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:29.071640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:29.078259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.078734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.079162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.079854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:29.080326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:29.080754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:29.109295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e9403d33-14c8-4071-9d3e-f4676ae53ea5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Sep 28 12:25:29.109837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 485/994] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:30.121768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:30.123933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:30.130426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.130903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.131336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.132022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:30.132500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:30.132923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:30.161744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6615dac5-d171-4ef5-a54e-dc5e4b8b0749 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Sep 28 12:25:30.162294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 510/995] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:31.173918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:31.176091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:31.183236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.183713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.184147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.184865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:31.185318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:31.185741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:31.216209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf024cf0-256a-474c-86f3-17636a5b0d74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046220 Sep 28 12:25:31.216816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 486/996] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:32.231008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:32.233270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:32.239605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.240077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.240551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.241236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:32.241688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:32.242105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:32.271706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5a0ba0d2-2626-4fa7-bab6-fede7e58888b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Sep 28 12:25:32.272245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 511/997] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:33.284210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:33.286418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:33.293331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.293812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.294247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.294933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:33.295381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:33.295800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:33.325552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a41662aa-edc2-4c2d-be9c-283f968324cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Sep 28 12:25:33.326114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 487/998] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:34.338507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:34.341402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:34.347779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.348230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.348695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.349381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:34.349826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:34.350242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:34.374492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:34.379511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1ae86a9f-be6d-47e5-b197-5aa2702badf9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 28 12:25:34.380064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 512/999] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:35.391984 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:35.394180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:35.400620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.401617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.402051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.402741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:35.403192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:35.403621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:35.432475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-68426173-d090-4886-b9ec-f0970aa1bb19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044318 Sep 28 12:25:35.433025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 488/1000] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:36.445275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:36.447416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:36.453850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.454322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.454752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.455431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:36.455875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:36.456290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:36.485153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a5495732-82e8-4e75-aaa1-9e18361dfb5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Sep 28 12:25:36.485717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 513/1001] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:37.498027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:37.500127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:37.502529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:37.507572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.508040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.508500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.509183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:37.509630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:37.510045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:37.539439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2819671d-cbcd-4757-9c20-68dbd84a8ce3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Sep 28 12:25:37.539975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 489/1002] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:38.551693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:38.553881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:38.560328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.560809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.561238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.561914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:38.562359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:38.562775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:38.592088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-59f9825d-fc6b-4cbc-8f24-082122e85435 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Sep 28 12:25:38.592869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 514/1003] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:39.605253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:39.607368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:39.613816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.614292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.614726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.615406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:39.615859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:39.616278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:39.618633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:39.646131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ac7a972-ca21-43d8-8f49-6b868158aa80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Sep 28 12:25:39.646688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 490/1004] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:40.658641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:40.660795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:40.667847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.668347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.668770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.669449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:40.669896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:40.670320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:40.698913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c510b6c5-28f9-40b7-b2f8-7320013af261 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Sep 28 12:25:40.699461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 515/1005] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:41.711073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:41.713826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:41.720172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.720668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.721131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.721805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:41.722250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:41.722664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:41.750596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f28c62c-fa72-462d-8db1-abe9c7a811eb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Sep 28 12:25:41.751065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 491/1006] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:42.762643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:42.764728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:42.771100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.771571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.771998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.772715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:42.773160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:42.773577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:42.802839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3aaffade-5013-4145-b102-5594ac090f0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Sep 28 12:25:42.803387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 516/1007] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:43.815191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:43.817367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:43.824182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.824689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.825121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.825806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:43.826260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:43.826677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:43.855360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db45bcbd-9410-4c2d-972c-3970b3a57bb9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Sep 28 12:25:43.855933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 492/1008] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:44.867753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:44.869893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:44.872187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=50 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:25:44.877350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:44.877820 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:44.878246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:44.878921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:44.879365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:44.879780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:44.908904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1bcd53ad-bff8-473e-89a2-1534403c1917 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Sep 28 12:25:44.909451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 517/1009] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:45.921278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:45.923386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:45.929812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.930280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.930707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.931382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:45.932366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:45.932785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:45.961391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84556d17-4bc2-42f7-9182-9bcd1bef94a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Sep 28 12:25:45.961934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 493/1010] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:46.973728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:46.975859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:46.983101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.983579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.984013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:46.984738 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:46.985191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:46.985615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:47.016088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-880a8bda-344c-4d3f-9625-988cd7953ff1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Sep 28 12:25:47.016672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 518/1011] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:48.027683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:48.029868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:48.036199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.036718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.037148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.037825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:48.038275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:48.038691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:48.066908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a414b04-310d-40a1-b2f8-6b24101ad066 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Sep 28 12:25:48.067443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 494/1012] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:49.079591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:49.081766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:49.088237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.088752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.089180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.089871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:49.090321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:49.090742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:49.120875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-49d45e46-acc3-432c-b1de-8138cd7f2981 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Sep 28 12:25:49.121429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 519/1013] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:50.133606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:50.136226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:50.142669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.143141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.143572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.144257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:50.144731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:50.145151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:50.174297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2507f88d-2723-4c6f-8aab-952218a269ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Sep 28 12:25:50.174848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 495/1014] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:51.187315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:51.189487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:51.195937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.196452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.196890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.198224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:51.198670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:51.199091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:51.228198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-540dc708-81fb-4f54-9235-af464ddf812c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Sep 28 12:25:51.228793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 520/1015] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:52.239866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:52.242006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:52.249017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.249496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.249930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.250617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:52.251067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:52.251491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:52.279580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-68459572-bad2-470b-a4af-9274647cedbc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 Sep 28 12:25:52.280127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 496/1016] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:53.292017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:53.294174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:53.300564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.301035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.301467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.302146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:53.302594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:53.303016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:53.332332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b53f1104-6f39-478e-adfb-6c92458fa2a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Sep 28 12:25:53.332894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 521/1017] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:54.345203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:54.347384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:54.353780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.354262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.354698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.355385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:54.355831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:54.356251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:54.384900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-25fa86d4-0f7e-4c25-87c5-25fad92c831e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Sep 28 12:25:54.385453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 497/1018] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:25:55.397467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:55.399598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:55.407208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.407208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.407657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.408714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:55.409518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:55.410273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:55.441221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-900b955d-1263-4215-b3e4-fd2d3d657fe5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047627 Sep 28 12:25:55.441768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 522/1019] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:56.453700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:56.455817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:56.462184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.463173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.463601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.464286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:56.464765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:56.465189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:56.495394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-247faf51-0ae5-43af-b14c-67a750bbbe69 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045638 Sep 28 12:25:56.495959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 498/1020] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:57.507591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:57.510261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:57.516614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.517087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.517516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.518201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:57.518650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:57.519072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:57.548651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-69fc7236-d384-4e27-9d63-2a8d09c9541c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Sep 28 12:25:57.549199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 523/1021] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:58.561541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:58.563695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:58.570031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:58.570501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:58.570927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:58.571638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:58.572728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:58.573146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:58.601603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b014b33c-ffb3-40b4-b269-fa0bde6be19a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Sep 28 12:25:58.602418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 499/1022] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:25:59.614553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:25:59.616757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:25:59.623783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.624261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.624721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.625400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:25:59.625856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:25:59.626278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:25:59.655268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-68e200a9-a667-4ae4-adf3-0369094a5ce9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Sep 28 12:25:59.655828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 524/1023] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:25:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:00.667676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:00.669858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:00.676341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.676818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.677255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.677943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:00.678392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:00.678815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:00.707470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6897df1a-f963-4324-ab1c-2f576833787c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Sep 28 12:26:00.708031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 500/1024] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:01.719782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:01.721943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:01.728606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.729080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.729501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.730180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:01.730645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:01.731045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:01.759619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8dacc2d5-5675-4256-9b25-ec31885a6de4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Sep 28 12:26:01.760103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 525/1025] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:02.772524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:02.775332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:02.781878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:02.782380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:02.782830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:02.783616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:02.784069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:02.784532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:02.818763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-664e4f22-d8d4-41c8-9daf-9005ee46a743 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050134 Sep 28 12:26:02.819246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 501/1026] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:03.830940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:03.833135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:03.839539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.840016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.840481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.841169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:03.841619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:03.842042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:03.871531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ca69cb5a-6016-463f-8f9c-411161a324a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 28 12:26:03.872085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 526/1027] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:04.882961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:04.885184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:04.891622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.892095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.892550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.893242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:04.893690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:04.894110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:04.922929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0dcf7f1-f3d0-4cb3-b19c-8409bc98ba39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Sep 28 12:26:04.923476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 502/1028] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:05.935625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:05.937808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:05.943895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:05.944403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:05.944839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:05.945529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:05.945979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:05.946404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:05.975871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-874a4a7b-d580-4b26-a01b-142209fa85c2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 28 12:26:05.976464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 527/1029] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:26:06.988565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:06.990665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:06.997021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:06.997495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:06.997921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:06.998597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:06.999042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:06.999457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:07.029228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96705c59-4e3d-4f8b-ac8e-adaf081a6fcc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 28 12:26:07.029772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 503/1030] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:08.041444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:08.044535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:08.050897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:08.051366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:08.051793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:08.052503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:08.052953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:08.053372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:08.056933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=92 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:08.228683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00da9376-6330-4166-b3a5-ec8958213bb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190969 Sep 28 12:26:08.229152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 528/1031] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:09.241643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:09.243728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:09.246657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:09.251904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.252470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.253282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.255146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:09.255590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:09.256010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:09.284062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f0808cd1-46d3-4676-b55f-a00e7ebd51a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Sep 28 12:26:09.284650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 504/1032] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:10.296952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:10.298953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:10.305343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:10.305809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:10.306234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:10.306909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:10.307351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:10.307769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:10.336771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-11aa002c-2a74-43dc-8e88-bfd58d488d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Sep 28 12:26:10.337316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 529/1033] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:11.349829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:11.352117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:11.359156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:11.359634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:11.360070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:11.360776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:11.361226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:11.361643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:11.365193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:11.389743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea16b3b0-3560-43dc-a6fa-9297fa415d78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Sep 28 12:26:11.390290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 505/1034] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:12.401583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:12.403691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:12.410089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.410566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.410999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.411689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:12.412143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:12.412594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:12.445155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5d8eeff1-2ac4-47e4-ae4b-3c7b5e1c8745 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Sep 28 12:26:12.445709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 530/1035] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:13.459242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:13.462101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:13.471011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:13.471494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:13.471934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:13.472671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:13.473132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:13.473560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:13.503746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-436710ba-196d-44a5-92a7-a59c58b4abfe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049941 Sep 28 12:26:13.504299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 506/1036] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:14.516982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:14.519071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:14.525906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:14.527076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:14.527515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:14.528213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:14.528701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:14.529128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:14.557923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-24e0cc79-fdd7-4eef-a1b8-6d7351ce3605 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Sep 28 12:26:14.558431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 531/1037] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:15.570383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:15.572524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:15.579994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:15.580514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:15.580943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:15.581622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:15.582065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:15.582480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:15.611210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ed90df75-25bb-4caf-9a7f-2e238e4ded9a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Sep 28 12:26:15.611751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 507/1038] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:16.623897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:16.626075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:16.628418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:16.633528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:16.634008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:16.634445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:16.635137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:16.636261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:16.636716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:16.665100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-584f3fbb-3202-4e5f-8faf-ad0961e6a9d7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Sep 28 12:26:16.665643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 532/1039] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:17.676743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:17.678836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:17.685778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:17.686254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:17.686681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:17.687361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:17.687810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:17.688228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:17.716098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-35f3804f-988a-49f4-bdeb-b5bb7f00fb27 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043301 Sep 28 12:26:17.716672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 508/1040] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:18.730472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:18.732613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:18.739023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:18.739498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:18.739930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:18.740649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:18.741098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:18.741521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:18.769636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f23241b8-7e10-4238-b101-31140d08132f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Sep 28 12:26:18.770181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 533/1041] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:19.782092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:19.784212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:19.790593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:19.791065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:19.791498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:19.792739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:19.793185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:19.793602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:19.822042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18f72fe2-65a8-4f09-b6e0-01600777d50b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Sep 28 12:26:19.822574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 509/1042] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:20.834494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:20.836707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:20.843752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:20.844233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:20.844707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:20.845386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:20.845851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:20.846248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:20.876484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b46842ee-019e-4887-b18f-14a6c230152c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Sep 28 12:26:20.877025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 534/1043] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:21.888806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:21.890926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:21.897426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:21.897901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:21.898330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:21.899003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:21.899446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:21.899862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:21.929684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0840df78-f55b-427d-b45f-4cb265ad48ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Sep 28 12:26:21.930234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 510/1044] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:22.942071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:22.944165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:22.951025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:22.951498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:22.951924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:22.952627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:22.953100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:22.953517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:22.982499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-586c2881-ac44-474f-8ffa-d925d190f3b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Sep 28 12:26:22.983042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 535/1045] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:23.995056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:23.997652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:24.004162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.004776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.005218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.005911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:24.006366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:24.006793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:24.036180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5da184d9-f6cc-4868-b2de-1c0002832b57 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Sep 28 12:26:24.036777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 511/1046] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:25.185869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:25.188044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:25.193907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.194381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.194813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.195488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:25.195932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:25.196404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:25.224068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-88e7e48f-8b22-454a-a9e7-39ba4692c0b8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178797 Sep 28 12:26:25.224632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 536/1047] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:26.236850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:26.238965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:26.245533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.246013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.246446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.247131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:26.247581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:26.248004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:26.277046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-026b5c7f-9a18-44d3-8317-cfc2e9a8cba1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Sep 28 12:26:26.277613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 512/1048] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:27.289955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:27.292604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:27.298932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.299412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.299845 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.300564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:27.301019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:27.301446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:27.330119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-38e3a2f4-f241-48a1-8228-270b988361c4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Sep 28 12:26:27.330661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 537/1049] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:28.342975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:28.345349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:28.351666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.352434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.352859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.353539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:28.354016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:28.354432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:28.382624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-627e5a1b-727a-4f33-b837-624735b92d54 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Sep 28 12:26:28.383155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 513/1050] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:29.395631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:29.397750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:29.404160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.404667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.405093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.405775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:29.406217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:29.406633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:29.436634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-11983693-fc66-4a30-8ea9-343e5c189a5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Sep 28 12:26:29.437169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 538/1051] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:30.449092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:30.451254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:30.457950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.458424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.458854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.459537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:30.459987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:30.460433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:30.489791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-251f635a-c996-44f3-a987-22c1f09b81cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Sep 28 12:26:30.490358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 514/1052] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:31.502507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:31.504642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:31.511861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.512366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.512796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.513479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:31.513928 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:31.514346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:31.542435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fbd6c093-9ed7-49bd-9b37-e6260d107777 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Sep 28 12:26:31.543273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 539/1053] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:32.555198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:32.557962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:32.564810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.565291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.565729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.566416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:32.566869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:32.567292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:32.596056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e04cfe62-dbf1-4d03-aed8-7ef253e1ac6a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Sep 28 12:26:32.596644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 515/1054] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:33.608921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:33.611026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:33.617560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.618030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.618458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.619132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:33.619576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:33.619994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:33.647722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ee6bfdd8-76f1-4f34-963a-a4f49024caed tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Sep 28 12:26:33.648256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 540/1055] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:34.659802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:34.661950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:34.668393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.668873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.669306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.669989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:34.670439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:34.670870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:34.699792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5a5ec17a-d288-40d8-b819-582f0a82eefb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Sep 28 12:26:34.700348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 516/1056] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:35.712189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:35.714372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:35.720540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.721014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.721441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.722128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:35.722576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:35.722994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:35.754119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f943733d-6f65-45c2-844f-c757883c4fda tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Sep 28 12:26:35.754608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 541/1057] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:36.070807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:36.071363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:36.077806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.078294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.078729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.079601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.080490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.081281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.107991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7a51584b-2fd9-43ce-ac46-9a39cea408e0 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e/ips" status: 200 len: 150 microversion: 2.20 time: 0.040972 Sep 28 12:26:36.108596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 517/1058] 10.222.0.26 () {60 vars in 1289 bytes} [Wed Sep 28 12:26:36 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:26:36.766327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:36.768423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:36.775002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.775473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.775907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.776614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:36.777060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:36.777479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:36.805323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0bbaa3d9-4519-40da-86b8-b5565436f0ca tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Sep 28 12:26:36.805865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 542/1059] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:37.818047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:37.820181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:37.826685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.827157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.827587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.828269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:37.828742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:37.829160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:37.858023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4c21a6c2-eb4e-4371-9618-f258fddd8dce tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Sep 28 12:26:37.858563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 518/1060] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:38.870810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:38.872979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:38.879262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.879732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.880161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.880866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:38.881313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:38.881730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:38.885937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=90 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:38.910730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5adb6fac-1179-4cad-b18a-b8b255b46e49 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Sep 28 12:26:38.911270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 543/1061] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:39.923604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:39.925765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:39.928033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:39.932790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.933268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.933696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.934376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:39.934821 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:39.935238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:39.964621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-96230017-c739-4992-9fca-e3b6954a8845 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Sep 28 12:26:39.965161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 519/1062] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:40.977478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:40.980127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:40.986551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.987019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.987451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:40.988129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:40.988605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:40.989031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:41.017706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-be420b42-8257-4e5d-aa76-34b9f6f287ac tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Sep 28 12:26:41.018182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 544/1063] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:42.029337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:42.031453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:42.037812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.038288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.038721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.039410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:42.039860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:42.040284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:42.044224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=88 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:42.069073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9702e611-825f-4b4e-a5fb-2135b2b713e3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Sep 28 12:26:42.069619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 520/1064] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:43.081856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:43.084012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:43.091106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.091586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.092021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.092740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:43.093196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:43.093626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:43.122105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d9e7b366-cca7-4700-b011-6b295b083a99 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Sep 28 12:26:43.122666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 545/1065] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:44.134398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:44.136720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:44.143162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.143637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.144068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.144793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:44.145242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:44.145662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:44.174840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b23f14af-f7c6-4941-854f-59f6f14daf56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Sep 28 12:26:44.175384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 521/1066] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:45.187830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:45.189985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:45.196463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.196940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.197975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.198659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:45.199107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:45.199529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:45.229075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8cc9cc2d-6976-4468-ad18-c21bd5817138 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Sep 28 12:26:45.229621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 546/1067] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:46.241396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:46.243446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:46.249802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.250306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.250736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.251421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:46.251869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:46.252285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:46.282995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86afe9ec-c258-4f5f-99eb-d48d5b518c36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Sep 28 12:26:46.283561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 522/1068] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:47.296172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:47.298350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:47.300639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=30 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:26:47.305952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.306420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.306848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.307525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:47.307968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:47.308407 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:47.336640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6efd865d-8cd6-4fe5-b741-259e7c6dde23 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 28 12:26:47.337179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 547/1069] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:48.349528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:48.351913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:48.358892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:48.359368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:48.359798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:48.360508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:48.360956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:48.361379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:48.389910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ea439467-66a5-48e8-a048-4836248be072 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Sep 28 12:26:48.390457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 523/1070] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:26:49.402239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:49.404381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:49.410794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.411278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.411714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.412438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:49.412896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:49.413325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:49.442971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a26bb2d-6295-40fb-b9a4-1f7302995611 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Sep 28 12:26:49.443546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 548/1071] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:50.163620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:50.164162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:50.171490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.172050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.172634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.173391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.174049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.174363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.199257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d1ad9dfe-9547-432c-a4b3-965b951077e6 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c/ips" status: 200 len: 147 microversion: 2.1 time: 0.039401 Sep 28 12:26:50.200007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 524/1072] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:26:50 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:50.460262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:50.462530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:50.469057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.469604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.470106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.470874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:50.471420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:50.471969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:50.519802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f87edbe8-c0c1-4b83-b3cd-313f27e9b24a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063418 Sep 28 12:26:50.520609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 549/1073] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:51.537718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:51.541476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:51.551103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:51.551841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:51.552537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:51.553606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:51.554306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:51.554965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:51.592161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2528431b-c68f-4f8f-acf8-f0f31a202c72 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060612 Sep 28 12:26:51.593340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 525/1074] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:52.607487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:52.609796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:52.618186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.618777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.619354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.620152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:52.620729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:52.621244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:52.654470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-24a23eab-4e52-435c-8fad-f45c3c8b5bd3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053283 Sep 28 12:26:52.655113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 550/1075] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:53.666834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:53.669072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:53.676428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.676927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.677346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.678038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:53.678486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:53.678901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:53.708786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc80d57f-c636-4b01-bd23-c06ca01cf239 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Sep 28 12:26:53.713606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 526/1076] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:54.721312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:54.723429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:54.730216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:54.730686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:54.731114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:54.731795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:54.732237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:54.732682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:54.761723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8be438a-5be2-42c4-bbe7-e840bce02a7e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Sep 28 12:26:54.762270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 551/1077] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:55.773672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:55.775872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:55.782446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.782929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.783362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.784058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:55.784537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:55.784965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:55.814735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb6814dd-a935-46e4-9a46-64b8145c5725 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Sep 28 12:26:55.815338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 527/1078] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:56.827116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:56.829254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:56.835809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.836280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.836732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.837422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:56.837866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:56.838787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:56.868095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a24c06b-8013-4613-8eb6-6758a916ff5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Sep 28 12:26:56.868761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 552/1079] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:57.880612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:57.882635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:57.889571 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:57.890056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:57.890486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:57.891183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:57.891635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:57.892057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:57.921261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9dc0f88-356b-4e14-81e9-36d5f3eef513 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Sep 28 12:26:57.922290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 528/1080] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:58.933651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:58.935779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:58.942036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.942509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.942940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.943629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:58.944073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:58.944524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:58.974651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-37bea456-f88b-4fad-bb29-c9a6e122016f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Sep 28 12:26:58.975191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 553/1081] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:26:59.986861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:26:59.989179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:26:59.995244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.995715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.996148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:26:59.996870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:26:59.997317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:26:59.997736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:00.027169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91d821c0-2068-4e07-9db7-86af3d7d41f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Sep 28 12:27:00.027712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 529/1082] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:26:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:01.038870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:01.041056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:01.047359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.047866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:01.048325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:01.049029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:01.049484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:01.049917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:01.079247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e5359ec5-1fba-4b8d-a3f3-53f63bb644e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Sep 28 12:27:01.079795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 554/1083] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:02.091794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:02.093941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:02.100243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:02.100794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.101217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.102173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:02.102618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:02.103036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:02.132635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c81fa816-196a-4adb-babe-74adc8529e1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Sep 28 12:27:02.133177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 530/1084] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:03.145279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:03.147420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:03.153820 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.154300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.154732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.155428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:03.155878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:03.156298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:03.186431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d3033856-e8e4-44be-bfe1-63e191160c88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Sep 28 12:27:03.186983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 555/1085] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:04.198639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:04.200859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:04.207214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.207693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.208115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.208834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:04.209281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:04.209702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:04.241016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9591008b-b787-4838-85a3-3407a2ce1a7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Sep 28 12:27:04.241586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 531/1086] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:27:05.253629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:05.255759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:05.262900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.263378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.263812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.264525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:05.264978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:05.265402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:05.295479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4fc5ed60-18ed-409e-a30c-b28bb75946ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Sep 28 12:27:05.296360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 556/1087] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:06.308087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:06.310924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:06.317377 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.317849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.318275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.318956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.319401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.319817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.348387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ed7c66a-2625-4d61-bc33-8bdf2c9d2d2d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Sep 28 12:27:06.348942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 532/1088] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:06.746269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:06.747356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:06.753481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.753963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.754399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.755093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:06.755662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:06.756093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:06.779573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1cb57591-a3ba-4f52-bcd5-a3017d9298fe tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d/ips" status: 200 len: 151 microversion: 2.1 time: 0.037206 Sep 28 12:27:06.780126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 557/1089] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:27:06 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:07.361983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:07.364114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:07.370988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:07.371471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:07.371903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:07.372634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:07.373088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:07.373512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:07.403217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7b7dd458-f9e0-4d64-830c-9d312031a7ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Sep 28 12:27:07.403852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 533/1090] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:08.415572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:08.417729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:08.424893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:08.425342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:08.425671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:08.426355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:08.426796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:08.427218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:08.457251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cc32ba1f-43d4-4249-a3da-7fe8326e455b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 28 12:27:08.457805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 558/1091] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:09.470180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:09.472441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:09.479162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:09.479636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:09.480094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:09.485180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:09.485647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:09.486080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:09.517357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2bdb15ca-1b26-49c5-9886-70135a73478c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051073 Sep 28 12:27:09.517917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 534/1092] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:10.529541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:10.531673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:10.538069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.538543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.538979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.539664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:10.540112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:10.540577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:10.544883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=94 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:10.570001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f0d5ea7c-69c1-45c8-a4d5-45101cc5e6ff tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Sep 28 12:27:10.570547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 559/1093] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:11.582296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:11.584499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:11.586787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=32 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:11.592350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.592832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.593261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.593947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:11.594402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:11.594805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:11.625843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e72dae27-f8fd-49e9-9da8-848d32789175 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Sep 28 12:27:11.626403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 535/1094] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:12.638719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:12.640920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:12.647000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.647495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.647901 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:12.648612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:12.649056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:12.649473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:12.678049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-696856cc-fa6b-41ce-bc2e-4cdcfea71e31 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Sep 28 12:27:12.678592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 560/1095] 10.222.0.26 () {58 vars in 1302 bytes} [Wed Sep 28 12:27:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:27:13.690199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:27:13.692349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:13.698797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.699768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.700201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.700905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.701352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.701765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.706196 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=94 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:27:13.796886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ce223bd-bf16-414b-8df2-623d1ccf3f3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action" status: 200 len: 81870 microversion: 2.1 time: 0.110296 Sep 28 12:27:13.797542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 536/1096] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:27:13 2022] POST /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/action => generated 81870 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 12:27:13.809998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:27:13.810480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:27:13.816809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.817276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.817700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.818376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:27:13.818824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:27:13.819255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:27:13.941450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lazy-loading 'services' on Instance uuid 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Request method failure captured: Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments/a18d01db-bf92-41d3-929d-b0be33a0483d HTTP/1.1 Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDsQW1VChzrlmGhdPJdyQ9MnD3_De3jKrJFEPkTYunwg0dhW79NltXi4Kuwsr0UL9pdv4dzyFqJvudyw7thip5Mpc5CQaqcx53kql6hqw4r1E6JGDkvAoAVQM3DEDhMqVknnv5rL6zn9nUrrfJGqyFBT-rgXNkohNOnIqqyBdoUh0hw Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: e271418048c1466e948bf84de04fc05f Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-TestMinimumBasicScenario-218185046 Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:27:14.044655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e271418048c1466e948bf84de04fc05f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e271418048c1466e948bf84de04fc05f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e271418048c1466e948bf84de04fc05f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e271418048c1466e948bf84de04fc05f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-TestMinimumBasicScenario-218185046 Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: e271418048c1466e948bf84de04fc05f Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-TestMinimumBasicScenario-218185046 Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-TestMinimumBasicScenario-218185046-project Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 4226c61349b440c3a502a7cbc592d883 Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-TestMinimumBasicScenario-218185046-project Sep 28 12:27:14.046416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'server_id': '4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84', 'id': 'a18d01db-bf92-41d3-929d-b0be33a0483d'} Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 28 12:27:14.047425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:27:14.048914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:27:14.050406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:27:14.052195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) Sep 28 12:27:14.054098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:27:14.055683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e67bc947-456d-465a-97bf-351b64b521b3) {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:27:14.055683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b601f619-a115-4b9a-9667-9e55dacd7fe8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments/a18d01db-bf92-41d3-929d-b0be33a0483d" status: 400 len: 269 microversion: 2.1 time: 0.239360 Sep 28 12:27:14.055683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 561/1097] 10.222.0.26 () {58 vars in 1416 bytes} [Wed Sep 28 12:27:13 2022] DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84/os-volume_attachments/a18d01db-bf92-41d3-929d-b0be33a0483d => generated 269 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:29:33.306765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:29:33.307632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.309128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.310157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:29:33.310301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:29:33.311604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:29:33.311908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:29:33.316589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:33.317176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:33.327273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.327754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.328188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.328913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.329366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.329796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.356550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:29:33.446652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-46e9a2dd-fc36-4c94-b9c9-0cf66c3d8d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 204 len: 0 microversion: 2.1 time: 0.140855 Sep 28 12:29:33.461765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 537/1098] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:29:33 2022] DELETE /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=29 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=19 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:29:33.461889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:29:33.469372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:33.470022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:33.489002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.489485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.489913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.490616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:33.491067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:33.491490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:33.623923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:33.632235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-42328206-8c2a-4258-9de8-5b38b74a4e60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.178566 Sep 28 12:29:33.632824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 562/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:34.655715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:34.656370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:34.665146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:34.665651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:34.666079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:34.666768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:34.667727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:34.668161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:34.673542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45950. Sep 28 12:29:34.850123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:34.859264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d51018ac-722c-43e8-af50-6ee6fe928a9a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.207689 Sep 28 12:29:34.859834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 538/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:35.882599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:35.883247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:35.894048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45974. Sep 28 12:29:35.898218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:35.898700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:35.899131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:35.899812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:35.900260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:35.900715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:36.041180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:36.050295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-091166c9-cdcf-4f06-9933-3200114d26a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.171587 Sep 28 12:29:36.050852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 563/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:35 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:37.073745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:37.074350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:37.081422 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:37.081897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:37.082328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:37.083010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:37.083463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:37.083881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:37.207178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:37.215694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4816cf2-0232-4318-bcb2-3e99741e4cc6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145748 Sep 28 12:29:37.216251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 539/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:38.239132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:38.239723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:38.246677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:38.247447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:38.247880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:38.248589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:38.249288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:38.249715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:38.372911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:38.380964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-87528e42-2d3e-411b-8b18-910c9c8d4e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145734 Sep 28 12:29:38.381523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 564/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:39.405061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:39.405593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:39.411943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:39.412466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:39.412901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:39.413591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:39.414048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:39.414483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:39.545325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:39.553453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dbca212f-a53a-4798-b6c2-59ca0dce8e18 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152859 Sep 28 12:29:39.554020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 540/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:40.580659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:40.581265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:40.587649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:40.588114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:40.588568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:40.589800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:40.590271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:40.591068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:40.717630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:40.725897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-62ef3815-e237-4c0b-aca6-00aabdf69496 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149419 Sep 28 12:29:40.726712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 565/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:40 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:41.748434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:41.749028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:41.755124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:41.755595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:41.756026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:41.756746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:41.757194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:41.757616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:41.910774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:41.919690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4f4d043-ef02-4e47-84d4-096760ac17be tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.175203 Sep 28 12:29:41.920256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 541/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:41 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:42.943209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:42.943876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:42.951405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:42.951955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:42.952485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:42.953337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:42.953795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:42.954518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:43.083531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:43.091761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7c7d5d3f-0f9f-4d94-8257-b143f1395cf1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152678 Sep 28 12:29:43.092353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 566/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:42 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:44.116174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:44.116806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:44.123737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:44.124205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:44.124673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:44.125350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:44.125796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:44.126212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:44.250710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:44.259204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93060ba1-3750-4301-8d93-73088e7a6513 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146851 Sep 28 12:29:44.259761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 542/1108] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:45.282750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:45.283361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:45.289927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:45.290394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:45.290824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:45.291504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:45.292478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:45.292896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:45.418118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:45.426608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-228afa19-8618-467b-876a-891abdd993e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147731 Sep 28 12:29:45.427184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 567/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:46.450458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:46.451060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:46.457497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:46.457977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:46.458412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:46.459105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:46.459557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:46.459982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:46.592611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:46.600804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d30d2b72-d4e2-44cb-a6ca-e1caf100733b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154899 Sep 28 12:29:46.601705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 543/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:47.625052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:47.625694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:47.632031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:47.632540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:47.632969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:47.633649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:47.634095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:47.634518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:47.764818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:47.772958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e16357e7-351f-4865-9e9b-3ae6c66ee3d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151730 Sep 28 12:29:47.773528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 568/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:47 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:48.796539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:48.797147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:48.806516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:48.807348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:48.808080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:48.809269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:48.810010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:48.810499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:48.937462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:48.945680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-41dbc184-d5b1-41f2-af55-fe2432df355f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153028 Sep 28 12:29:48.946240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 544/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:48 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:29:49.969944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:49.970552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:49.977240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:49.977745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:49.978172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:49.978844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:49.979923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:49.980368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:50.107744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:50.115884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2a703587-52db-4b67-86f6-c934a85ca125 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149787 Sep 28 12:29:50.116501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 569/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:49 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:51.140843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:51.141487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:51.147849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:51.148345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:51.148784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:51.149468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:51.149918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:51.150340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:51.283773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:51.292961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4ad82c3-56ca-4d63-abd9-54e2b453c7c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155972 Sep 28 12:29:51.293760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 545/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:52.316656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:52.317262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:52.324121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:52.324627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:52.325059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:52.325736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:52.326179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:52.326600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:52.507699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:52.516553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-53e3902d-0af1-48b6-9d8f-849d434553c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.203752 Sep 28 12:29:52.517109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 570/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:53.539479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:53.540181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:53.546903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:53.547393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:53.547829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:53.548585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:53.549040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:53.549460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:53.674937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:53.683553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa82b659-0d13-44b0-9e03-e1019a042b6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148015 Sep 28 12:29:53.684117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 546/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:54.707138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:54.707756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:54.714630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:54.715111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:54.715545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:54.716228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:54.716710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:54.717132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:54.845565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:54.853922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bf235af6-cc1d-4bf7-a81f-4b0bcadd087b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150635 Sep 28 12:29:54.854981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 571/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:54 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:55.878486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:55.879088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:55.886194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.886660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.887085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:55.887773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:55.888215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:55.888660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:56.031464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:56.042637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8e9a3a60-91fa-4693-aa6c-eb355dd6edb9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.167927 Sep 28 12:29:56.043206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 547/1118] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:57.070175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:57.071220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:57.077945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:57.078493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:57.078935 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:57.079669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:57.080260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:57.080767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:57.209526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:57.217668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-037a8b4b-3d75-4011-a71a-7b83a0c221d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153089 Sep 28 12:29:57.218230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 572/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:58.242216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:58.242824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:58.249187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:58.249654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:58.250089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:58.250768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:58.251211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:58.251631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:58.382702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:58.390785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf9c817a-14b0-41d2-bf21-a675b9bbd333 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152307 Sep 28 12:29:58.391348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 548/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:29:59.413936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:29:59.414475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:29:59.421028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:59.421506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:59.421936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:59.422625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:29:59.423074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:29:59.423495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:29:59.552488 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:29:59.560732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-289596f0-a0b2-4a01-bc91-65a7424e5316 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150684 Sep 28 12:29:59.561295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 573/1121] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:29:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:00.584548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:00.585179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:00.592565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.593044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.593483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.594220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:00.594667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:00.595089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:00.722613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:00.731666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2d38ca6-01a0-4ea3-b6e0-3b920c0fd7f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150952 Sep 28 12:30:00.736425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 549/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:00 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:01.754782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:01.755513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:01.761906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:01.762376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:01.762992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:01.763682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:01.764417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:01.764843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:01.895270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:01.904047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fe22aa84-9b18-4d93-8f73-a28fd4f90f3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153186 Sep 28 12:30:01.904644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 574/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:01 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:02.927900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:02.928807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:02.935304 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:02.935787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:02.936223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:02.936938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:02.937391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:02.937866 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:03.074446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:03.082835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8684029a-faef-4d02-a882-32ded35197f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158737 Sep 28 12:30:03.083341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 550/1124] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:30:04.106440 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:04.107054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:04.110434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=27 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:04.113965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:04.114444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:04.114872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:04.115554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:04.115996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:04.116436 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:04.134185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=79 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:04.253578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:04.262314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ba715d82-a052-4abb-8dfa-4e8070af9ffc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.159983 Sep 28 12:30:04.262876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 575/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:05.285340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:05.285950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:05.287843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:05.293694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:05.294171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:05.294609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:05.295293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:05.295749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:05.296174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:05.300874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:05.425340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:05.434346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-12b8fdce-06ee-4c31-a451-2953385727ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152925 Sep 28 12:30:05.434976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 551/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:06.457520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:06.458126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:06.464245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:06.464747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:06.465327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:06.466007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:06.466457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:06.466877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:06.591722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:06.599996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1c17c00e-8c07-4016-822a-260af6f3a206 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146284 Sep 28 12:30:06.600827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 576/1127] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:07.623038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:07.623649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:07.630227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:07.630714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:07.631142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:07.631826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:07.632277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:07.632727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:07.765908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:07.774249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3995e30-7fe2-4e19-943f-032b6251389f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155083 Sep 28 12:30:07.774861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 552/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:07 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:08.798777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:08.799381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:08.809502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:08.810346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:08.811119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:08.812412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:08.812876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:08.813305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:08.940960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:08.949642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9f2da836-5316-4c88-8258-ffd5cdd19305 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154729 Sep 28 12:30:08.950208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 577/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:08 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:09.972591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:09.973204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:09.980509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:09.980994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:09.981424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:09.982108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:09.982564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:09.982985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:10.109228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:10.117364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-72d3234c-2519-4a38-98ff-f9693d8f2be0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148676 Sep 28 12:30:10.117926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 553/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:11.141042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:11.141565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:11.148024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:11.148538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:11.148969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:11.149654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:11.150102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:11.150528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:11.279815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:11.288166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-44ac26b5-14e6-4302-b6f6-2ac1ea1e21d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150961 Sep 28 12:30:11.288754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 578/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:12.311333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:12.311945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:12.318787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:12.319054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:12.319487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:12.320180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:12.320660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:12.321088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:12.453949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:12.462421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc67a344-6396-46e7-8f73-641c268c1a46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155598 Sep 28 12:30:12.463098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 554/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:13.485538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:13.486142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:13.492903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:13.493459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:13.493958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:13.494742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:13.495368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:13.495791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:13.623731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:13.632183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f67d6b0a-a542-4f3b-bb2b-d1b46ec3853d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150442 Sep 28 12:30:13.632797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 579/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:14.655956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:14.657966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:14.663085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:14.663516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:14.663837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:14.664566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:14.665019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:14.665438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:14.797402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:14.805632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-62e08817-315b-4621-9bc1-2d4b2c31872b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153428 Sep 28 12:30:14.806205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 555/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:14 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:15.828720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:15.829330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:15.835896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:15.836435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:15.836869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:15.837552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:15.838018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:15.838435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:15.966120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:15.974407 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5cefab23-6350-42ce-ae8d-3551179a1255 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149542 Sep 28 12:30:15.974983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 580/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:15 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:16.998778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:16.999388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:17.005799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:17.006220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:17.006651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:17.007337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:17.007785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:17.008207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:17.135944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:17.144051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87a58ace-f387-466f-9ce3-47eb4d7a5f55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149237 Sep 28 12:30:17.144654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 556/1136] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:18.167003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:18.167553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:18.173954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:18.174432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:18.174864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:18.175547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:18.175997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:18.176452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:18.309417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:18.319602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a16684e-e3a6-4422-9deb-78dc10594c50 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156951 Sep 28 12:30:18.320827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 581/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:19.343438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:19.344125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:19.350541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:19.351013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:19.351699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:19.352406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:19.352856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:19.353274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:19.481026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:19.489423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-098ed668-f7c4-4be8-b2a8-d18297490b76 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150212 Sep 28 12:30:19.490015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 557/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:20.520390 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:20.521006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:20.528019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:20.528784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:20.529223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:20.529925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:20.530380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:20.530805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:20.672834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:20.681280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ebe7bb8e-15ba-4d5a-b5b6-f514c1d3b4b8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.164741 Sep 28 12:30:20.682100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 582/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:21.705759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:21.706364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:21.713305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:21.713780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:21.714210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:21.714893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:21.715343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:21.715773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:21.844007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:21.852376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-184c931e-7236-4f9d-9df9-94f87b279f7d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150464 Sep 28 12:30:21.852944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 558/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:22.875630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:22.876246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:22.882630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:22.883093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:22.883521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:22.884205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:22.884723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:22.885143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:23.019859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:23.028531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b609b3f3-7d5e-476f-8b85-c641c5bbf2c9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156661 Sep 28 12:30:23.029098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 583/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:22 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:24.052389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:24.052998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:24.060122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:24.060688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:24.061117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:24.061817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:24.062250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:24.062670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:24.202376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:24.211170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9b07df4-74c1-4ebb-8c58-cf78cc3a56a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.162630 Sep 28 12:30:24.211734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 559/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:30:25.235242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:25.235782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:25.242257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:25.242737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:25.243166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:25.244374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:25.244830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:25.245257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:25.377799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:25.386650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a90f2660-fed8-4069-9b11-b9f085e790a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155368 Sep 28 12:30:25.387208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 584/1143] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:26.409764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:26.410381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:26.416808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:26.417286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:26.417717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:26.418439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:26.418889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:26.419312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:26.554800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:26.562815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-969cc630-d52f-46c2-bf02-f43ef47674a9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156822 Sep 28 12:30:26.563380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 560/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:27.586295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:27.586900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:27.593739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:27.594210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:27.594637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:27.595318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:27.595778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:27.596181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:27.725743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:27.734632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1ced463b-90f5-482a-be0e-83b127529e44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152202 Sep 28 12:30:27.735187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 585/1145] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:27 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:28.756966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:28.757538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:28.763893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:28.764396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:28.764840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:28.765532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:28.766001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:28.766425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:28.922656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:28.930912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-507cd106-ab77-4fd5-9108-3f095a2ccb33 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.177864 Sep 28 12:30:28.931526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 561/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:29.955500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:29.956715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:29.963737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:29.964154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:29.964613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:29.965297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:29.965745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:29.966166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:30.097036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:30.105980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7d19a42d-8113-4dfb-8617-1ad7d185ce60 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155383 Sep 28 12:30:30.106541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 586/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:31.129455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:31.130061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:31.137217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:31.137694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:31.138153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:31.138840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:31.139286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:31.139709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:31.268626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:31.277172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdc235ce-a315-4a20-8952-e118f81c39c0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151514 Sep 28 12:30:31.277745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 562/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:32.300222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:32.300895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:32.307582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:32.308064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:32.308532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:32.309224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:32.309686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:32.310133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:32.448164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:32.456606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bfcec6ff-f4c0-4b5d-abb7-3dde10e00860 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160237 Sep 28 12:30:32.457173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 587/1149] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:33.485815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:33.486429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:33.493150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:33.493665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:33.494090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:33.495270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:33.495270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:33.495623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:33.621398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:33.629483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b8be1f71-582d-485f-8a16-7e162c124b13 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152795 Sep 28 12:30:33.629993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 563/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:34.653835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:34.654380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:34.656695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=26 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:34.662025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:34.662494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:34.662921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:34.663599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:34.664042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:34.664489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:34.667418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=78 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:34.793664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:34.801987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a9d57a7f-3eba-465c-a812-4a45fa5936bd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152657 Sep 28 12:30:34.802561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 588/1151] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:35.826078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:35.826679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:35.828540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:35.834086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:35.834583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:35.835012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:35.835694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:35.836137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:35.836583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:35.840429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=78 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:30:35.971093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:35.979521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e783ae7d-7fa2-48d3-a511-70e042c750e3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.157974 Sep 28 12:30:35.980082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 564/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:35 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:37.007836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:37.008501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:37.014974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.015452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.015888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.016617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:37.017077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:37.017507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:37.142462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:37.150639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-21e11711-6df7-4188-b9ca-4ba40010368a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146829 Sep 28 12:30:37.151212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 589/1153] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:38.173845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:38.174372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:38.180917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.181394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.181829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.182520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:38.182965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:38.183388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:38.309091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:38.317202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eba6d635-8557-4e64-9371-d108eb165741 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147316 Sep 28 12:30:38.317765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 565/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:39.341595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:39.342205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:39.348788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:39.349268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:39.349700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:39.350381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:39.350833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:39.351261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:39.497710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:39.506246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3503d5fe-2daa-4083-bf72-a6ec100ebb95 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.168969 Sep 28 12:30:39.506822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 590/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:40.529921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:40.530533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:40.536842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:40.537364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:40.537737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:40.538429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:40.538884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:40.539308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:40.665477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:40.674362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6226a880-edab-4906-93a1-38d783025ab5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148880 Sep 28 12:30:40.675248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 566/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:40 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:41.697694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:41.698312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:41.705530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:41.705757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:41.706195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:41.706880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:41.707328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:41.707751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:41.834787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:41.843074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-777d51d8-a912-4a00-a9a5-6635a749734b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149254 Sep 28 12:30:41.843635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 591/1157] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:41 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:42.866211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:42.866817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:42.874073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:42.874549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:42.874987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:42.875677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:42.876128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:42.876591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:43.012230 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:43.020707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ea4b3bd-0972-4527-9798-3c33cc92a6ce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158172 Sep 28 12:30:43.021277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 567/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:42 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:44.043104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:44.043751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:44.050230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:44.050709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:44.051143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:44.051829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:44.052285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:44.052733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:44.180702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:44.189686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3f3d4412-eadd-4835-a4c6-ff6b730d8e91 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150446 Sep 28 12:30:44.190262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 592/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:45.212890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:45.213503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:45.220012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:45.220529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:45.220983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:45.221660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:45.222108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:45.222530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:45.368720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:45.378237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d7a73c71-d7b2-4d95-a0bc-8c52736db195 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.169187 Sep 28 12:30:45.384972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 568/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:46.401305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:46.401919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:46.409325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:46.410197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:46.410802 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:46.411658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:46.412108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:46.412810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:46.563069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:46.572872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4b229ed7-dad5-474a-8e77-cdbae8204389 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.175355 Sep 28 12:30:46.573406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 593/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:47.598505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:47.599122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:47.606850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:47.607329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:47.607765 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:47.608547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:47.608963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:47.609386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:47.743474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:47.752125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9d0c2d3c-f196-4dda-9141-59100e7b6dde tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158647 Sep 28 12:30:47.752796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 569/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:47 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:48.775351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:48.775874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:48.782629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:48.783101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:48.783534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:48.784255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:48.784730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:48.785155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:48.918848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:48.927328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-23d40f29-4293-4362-9ff1-80769e6309e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155899 Sep 28 12:30:48.928195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 594/1163] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:48 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:49.957863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:49.957863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:49.978618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:49.979106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:49.979741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:49.981592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:49.982292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:49.983580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:50.169057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:50.180028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4f5c0b9-18ea-4703-af20-3fc2bf8e3921 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.231699 Sep 28 12:30:50.180685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 570/1164] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:49 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:51.205583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:51.206197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:51.212615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:51.213087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:51.213515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:51.215180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:51.215672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:51.216115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:51.352642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:51.361227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-27d3ddc9-506f-4726-9989-092522863908 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.159454 Sep 28 12:30:51.361998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 595/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:52.385004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:52.385784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:52.392280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:52.392759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:52.393219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:52.394159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:52.394643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:52.395109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:52.530742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:52.538926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d65b9fd2-4bb8-4638-b50a-1f4b42bd0d1b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158327 Sep 28 12:30:52.539766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 571/1166] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:53.562501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:53.563101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:53.569479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:53.569933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:53.570355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:53.571041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:53.571487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:53.571903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:53.701830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:53.709945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d1bf12c0-b769-4915-9468-686a8c71f2eb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151850 Sep 28 12:30:53.710501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 596/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:54.734327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:54.734940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:54.741539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:54.742021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:54.742457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:54.743153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:54.743610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:54.744036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:54.872844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:54.880991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83fb3a07-285e-45a6-a7e4-6b1eda1241cc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151040 Sep 28 12:30:54.881560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 572/1168] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:54 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:55.904030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:55.904664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:55.910993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:55.911459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:55.911884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:55.912637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:55.913057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:55.913454 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:56.040544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:56.048682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9a46f742-6c29-4d29-973f-dc26079369d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148461 Sep 28 12:30:56.049248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 597/1169] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:57.075960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:57.076594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:57.082885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.083354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.083778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.084491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:57.084940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:57.085356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:57.212521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:57.221247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8b49859f-ffb9-47e2-9ccb-7baa61614052 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149589 Sep 28 12:30:57.221825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 573/1170] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:58.244520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:58.245061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:58.251356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:58.251834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:58.252263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:58.252976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:58.253424 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:58.253856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:58.385220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:58.394276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-749a61a6-2f93-49e9-a865-4eeeb1c35235 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153714 Sep 28 12:30:58.395179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 598/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:30:59.417926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:30:59.418536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:30:59.425133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.425622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.426063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.426763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:30:59.427222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:30:59.427654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:30:59.554962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:30:59.563926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f60b254-09d1-4534-ada3-57a0868d1f82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149803 Sep 28 12:30:59.564517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 574/1172] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:30:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:00.587057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:00.587648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:00.594155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.594556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.594994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.595714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:00.596168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:00.596709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:00.734979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:00.743108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c62d58f6-e8cf-42dc-b515-28b716ce8aa0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160002 Sep 28 12:31:00.743673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 599/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:00 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:01.766556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:01.767170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:01.773499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.773972 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.774395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.775073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:01.775520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:01.775935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:01.904746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:01.912799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c2871f13-d9aa-4029-a69d-6e3564c00ef8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150054 Sep 28 12:31:01.913358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 575/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:01 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:02.937105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:02.937716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:02.944035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.944552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.944986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:02.945673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:02.946125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:02.946546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:03.099627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:03.108579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-04b3a0bf-2fcc-4cc2-973f-549a63045949 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.176067 Sep 28 12:31:03.109142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 600/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:04.132144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:04.132825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:04.139172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.139650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.140083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.140795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:04.141246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:04.141667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:04.267113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:04.275225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66cae5e4-1fdd-442a-9d93-ab376fca2241 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146901 Sep 28 12:31:04.275731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 576/1176] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:05.299592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:05.300209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:05.302547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=26 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:05.308057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.308574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.309021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:05.309723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:05.310178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:05.310658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:05.314999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=78 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:05.452404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:05.460514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b3a54778-c916-4fec-845c-4d5dc94aeb4e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.164775 Sep 28 12:31:05.461069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 601/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:06.485173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:06.486782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:06.496491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:06.496491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:06.496491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:06.496491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:06.496864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:06.496864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:06.497057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:06.500487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=78 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:06.627296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:06.635517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0ff7c5ce-8f34-4d8e-b77e-094975a12c0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155854 Sep 28 12:31:06.636067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 577/1178] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:07.658820 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:07.659425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:07.665680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.666090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.666521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.667197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:07.667642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:07.668057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:07.796927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:07.805259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5f753f36-78f0-4b93-b978-f1aca1ba67d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150220 Sep 28 12:31:07.805831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 602/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:07 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:08.830288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:08.830897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:08.837292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.837762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.838188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.838895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:08.839338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:08.839756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:08.965542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:08.973660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c34a0ddb-06c0-4fac-8e29-4348fd71be10 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147171 Sep 28 12:31:08.974214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 578/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:08 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:09.997887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:09.998499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:10.004947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:10.005422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:10.005854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:10.006536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:10.006989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:10.007413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:10.133584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:10.141922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-26e62adf-5301-41e3-bd70-d2a3f33cc062 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148576 Sep 28 12:31:10.142599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 603/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:11.165728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:11.166372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:11.173330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:11.173808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:11.174239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:11.174921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:11.175372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:11.175796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:11.303427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:11.312385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9928904-6fe1-492f-a136-5ab3f87902ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150444 Sep 28 12:31:11.312949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 579/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:12.334778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:12.335565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:12.342013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.342487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.342919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:12.343607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:12.344057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:12.344512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:12.471838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:12.481198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3e1991a3-892e-4c15-9a3d-1de60d5695c7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150177 Sep 28 12:31:12.481912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 604/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:13.503732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:13.504365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:13.512037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.512552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.512983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.513674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:13.514125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:13.514546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:13.641950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:13.650045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b2ee552-32d7-4887-b871-360cfbc18f65 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150096 Sep 28 12:31:13.650607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 580/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:14.865808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:14.866430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:14.873515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.874242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.875038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:14.876040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:14.876956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:14.877404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:15.015751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:15.024085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4a5613f0-b8d0-42e3-a426-92fc79352de5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.354306 Sep 28 12:31:15.024690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 605/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:14 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:16.046865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:16.047469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:16.053938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.054406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.054830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.055508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:16.055947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:16.056384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:16.186937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:16.195103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6bf3eafc-b1c2-400d-b379-1d57061368aa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152074 Sep 28 12:31:16.195678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 581/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:17.219185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:17.219711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:17.226039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.226759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.227218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.227895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:17.228361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:17.228782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:17.353060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:17.361435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9ee83aa8-1ec8-4981-853f-9c6dc94373f5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145853 Sep 28 12:31:17.362000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 606/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:17 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:18.384331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:18.384951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:18.391421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:18.391889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:18.392334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:18.393019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:18.393464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:18.393877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:18.522193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:18.530728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5b47f5b-ed54-4ef1-9dfa-f7cee4b27b6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150236 Sep 28 12:31:18.531293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 582/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:19.555685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:19.556349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:19.563579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.564054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.564521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.565204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:19.565678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:19.566103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:19.696200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:19.704356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-22186955-2252-478c-9e0b-eb4cb7a789e9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152468 Sep 28 12:31:19.704925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 607/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:20.728026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:20.728649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:20.735124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.735594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.736021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.736735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:20.737188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:20.737602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:20.876963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:20.886956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-655ab106-7aca-4a66-bffe-7040c06c21f2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.162437 Sep 28 12:31:20.887949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 583/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:21.910388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:21.911024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:21.917477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.917953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.918384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:21.919073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:21.919523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:21.919956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:22.048609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:22.056704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-431611b6-42b6-4b5c-b24a-bb6bac35e02e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150212 Sep 28 12:31:22.057267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 608/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:23.079787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:23.080425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:23.086781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:23.087259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:23.087690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:23.088402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:23.089348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:23.089799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:23.212268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:23.221045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6d0dcd7-94ff-496e-8b79-0d7be89d65c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145043 Sep 28 12:31:23.221671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 584/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:23 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:24.244922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:24.245465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:24.251838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:24.252339 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:24.252776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:24.253460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:24.253913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:24.254336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:24.390975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:24.399158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9656566f-90dd-4736-9c50-22d093fc6992 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158158 Sep 28 12:31:24.399821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 609/1193] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:25.422442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:25.423057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:25.429102 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:25.429582 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:25.430025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:25.430709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:25.431159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:25.431575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:25.559247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:25.567267 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00a9ecca-dedc-4a0d-825b-93d3429f17d0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148542 Sep 28 12:31:25.567865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 585/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:26.590640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:26.591251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:26.597660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:26.598136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:26.598565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:26.599252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:26.599700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:26.600125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:26.730169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:26.738263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2fa1d5f0-500b-4b91-9e6c-391377bd65ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151475 Sep 28 12:31:26.738832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 610/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:27.762365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:27.762969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:27.769408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:27.769882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:27.770312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:27.770997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:27.771446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:27.771870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:27.897149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:27.905880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a22e5a2a-d8a3-4733-a400-7417a3b2302d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147904 Sep 28 12:31:27.906453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 586/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:27 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:28.928718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:28.929328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:28.936221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:28.936725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:28.937152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:28.937831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:28.938274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:28.938693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:29.064415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:29.072668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-70ebbe97-6667-41a5-8cba-d3d5371832f1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147767 Sep 28 12:31:29.073235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 611/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:30.097031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:30.098101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:30.107616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:30.108091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:30.108558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:30.109247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:30.109696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:30.110116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:30.239116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:30.248109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42405486-3de6-4940-a99c-c92e8497bfac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155228 Sep 28 12:31:30.248906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 587/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:30 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:31.271255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:31.271866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:31.278832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:31.279306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:31.279732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:31.280440 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:31.280887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:31.281308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:31.408660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:31.416791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-06d2b17a-6b77-48cc-9990-e7a4d31f6fc5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149350 Sep 28 12:31:31.417355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 612/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:32.440409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:32.441020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:32.447296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:32.447770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:32.448200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:32.449427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:32.449877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:32.450300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:32.578864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:32.587010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b756b15-381e-474c-ac6d-4dc1de4b7d0e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150386 Sep 28 12:31:32.587575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 588/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:33.611300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:33.612033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:33.618533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.619016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.619443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.620134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:33.620615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:33.621038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:33.747435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:33.755839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2c4b292f-ce1e-4093-87ff-685007ece7b5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148578 Sep 28 12:31:33.756420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 613/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:34.779353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:34.779964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:34.786129 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.786599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.787026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.787742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:34.788189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:34.788637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:34.920896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:34.929047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4e96d12-3c31-4f30-9c5f-91ad6a60d750 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153981 Sep 28 12:31:34.929626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 589/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:35.953977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:35.954585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:35.956656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=26 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:35.961917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.962391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.962817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.963505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:35.963944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:35.965009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:35.967757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=78 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:36.100433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:36.108811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9c064e17-1f17-48b7-b3e7-71549e09391c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.159008 Sep 28 12:31:36.109383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 614/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:35 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:31:37.131428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:37.132040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:37.134350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:37.140212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.140715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.141152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:37.141840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:37.142295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:37.142719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:37.145470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=78 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:31:37.268524 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:37.276760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddebaeed-f8af-4686-9385-98ebe3013945 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149003 Sep 28 12:31:37.277266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 590/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:38.299553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:38.300167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:38.306654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:38.307131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:38.307568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:38.308494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:38.309297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:38.309996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:38.439898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:38.447982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d287b43c-bb44-49d3-8d8e-b77d96b88517 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152250 Sep 28 12:31:38.449082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 615/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:39.470775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:39.471333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:39.478125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:39.478603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:39.479036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:39.479735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:39.480188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:39.480640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:39.606200 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:39.614273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a1a1ef90-7c01-40f5-8a1b-0d468254a02d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147542 Sep 28 12:31:39.614846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 591/1206] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:40.638178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:40.638780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:40.645187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.645661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.646086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.646773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:40.647216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:40.647635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:40.779724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:40.787711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a7331040-8726-42f2-b3e5-4ae6c8feccbd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153521 Sep 28 12:31:40.788273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 616/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:40 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:41.811880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:41.812522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:41.819098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.819573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.820007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.820727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:41.821185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:41.821606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:41.950465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:41.958484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42bee663-2248-4b09-ba72-4678f45e501f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151116 Sep 28 12:31:41.959045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 592/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:41 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:42.982835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:42.983447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:42.990418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.990895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.991327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:42.992014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:42.992506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:42.992934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:43.124088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:43.132929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f4909280-d078-4fb3-9ddc-28661e7c148f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154613 Sep 28 12:31:43.136836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 617/1209] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:42 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:44.156755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:44.157359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:44.163639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:44.164114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:44.164574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:44.165259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:44.165707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:44.166125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:44.294043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:44.302137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a6855818-ace0-4634-bb70-0b7772d507ef tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149131 Sep 28 12:31:44.302701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 593/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:45.325335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:45.325976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:45.332379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.332852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.333280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:45.333960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:45.334430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:45.334861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:45.468826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:45.477060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-16233bc3-6674-4fcc-a42f-1be2e85322e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155779 Sep 28 12:31:45.477622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 618/1211] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:46.501492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:46.502090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:46.510016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:46.510016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:46.510388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:46.511390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:46.512122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:46.512824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:46.643500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:46.652504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-605b2a8a-d09a-4bf4-966c-cd38928b8f6e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154333 Sep 28 12:31:46.653069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 594/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:47.675879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:47.676525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:47.683496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.683981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.684579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.685271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:47.685722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:47.686148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:47.812868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:47.821097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-98b8478e-495f-412b-901f-9c6678d74d5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149031 Sep 28 12:31:47.821654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 619/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:47 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:48.843358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:48.843916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:48.850265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.850738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.851190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.852122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:48.852592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:48.853011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:48.978992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:48.987600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b5e2c50-da41-468a-827b-7dc3a1b80321 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148208 Sep 28 12:31:48.988165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 595/1214] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:48 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:50.013961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:50.014500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:50.021280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.021752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.022181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.022864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:50.023310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:50.023728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:50.150130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:50.159108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a42bb8bd-0f8f-4877-96c6-4aea2e8d6459 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149594 Sep 28 12:31:50.159707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 620/1215] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:50 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:51.182965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:51.183574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:51.190006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:51.190482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:51.190915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:51.191597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:51.192046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:51.192495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:51.315165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:51.323184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d1df22b-c0b1-4bc6-9dbd-98eda8627164 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.144076 Sep 28 12:31:51.324257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 596/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:52.349554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:52.350156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:52.357293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:52.357767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:52.358192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:52.358869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:52.359320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:52.359735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:52.486444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:52.495061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ba81dacc-670c-4ad3-8ddc-d1e172f7f47a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149117 Sep 28 12:31:52.495403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 621/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:53.517941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:53.518581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:53.525151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.525623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.526055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.527385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:53.527837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:53.528264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:53.655764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:53.664182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-31cac2fa-bd26-493a-ac67-e0b933a26118 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150043 Sep 28 12:31:53.665364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 597/1218] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:54.687290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:54.687979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:54.694616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.695160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.695669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.696411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:54.696871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:54.697295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:54.834333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:54.843213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7747ed3a-c9ec-4146-9b36-b8b097adc7d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160034 Sep 28 12:31:54.843770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 622/1219] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:54 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:55.866709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:55.867315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:55.875231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.875703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.876127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:55.876937 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:55.877364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:55.877783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:56.016483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:56.024979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-905728e7-16d0-48ea-ba07-d89ce15800a5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.161999 Sep 28 12:31:56.025552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 598/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:57.048786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:57.049394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:57.055646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:57.056168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:57.056582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.057258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:57.058387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:57.058804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:57.183242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:57.191284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7e09b642-9020-4c44-a2b4-4f8f4b4ecaf2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146303 Sep 28 12:31:57.191844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 623/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:58.214079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:58.214696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:58.221148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.221608 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.222042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:58.222730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:58.223179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:58.223600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:58.355635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:58.364953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-23701b19-527b-467d-97a8-831c534e3a11 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154622 Sep 28 12:31:58.365751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 599/1222] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:31:59.389386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:31:59.389989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:31:59.396876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:59.397362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:59.397793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:59.398500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:31:59.398951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:31:59.399393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:31:59.532648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:31:59.541006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1a502bb9-3404-4bb9-abed-395f87e1987d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155938 Sep 28 12:31:59.541578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 624/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:31:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:00.564035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:00.564773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:00.572491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.573058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.573540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.574246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:00.574806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:00.575273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:00.719229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:00.728169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c9f46ea6-ef1c-44e4-aea9-a4d28d3e9ad4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.167894 Sep 28 12:32:00.728790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 600/1224] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:00 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:01.752097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:01.752729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:01.759452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:01.759930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:01.760384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:01.761104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:01.761550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:01.761968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:01.889467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:01.898522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1f2ef384-4bb3-49b3-af8a-233e6afd32d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150473 Sep 28 12:32:01.899113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 625/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:01 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:02.922953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:02.923754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:02.930555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:02.930963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:02.931415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:02.932104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:02.932627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:02.933037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:03.066171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:03.075141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f4f990e-1962-4a8d-b34d-e15d5f7b86c4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156803 Sep 28 12:32:03.075720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 601/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:04.098683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:04.099297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:04.106727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:04.107219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:04.107671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:04.108385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:04.108840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:04.109269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:04.239634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:04.248009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-10d02217-9bca-4813-af50-1cc831b6990d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153235 Sep 28 12:32:04.248797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 626/1227] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:05.271316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:05.271884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:05.278771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:05.279329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:05.279670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:05.280542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:05.280836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:05.281259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:05.426511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:05.434625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-28bf27ad-6f92-474d-89d8-b8319641585b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.167386 Sep 28 12:32:05.435187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 602/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:06.458240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:06.458854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:06.461017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=26 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:06.466855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:06.467335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:06.467770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:06.468586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:06.469075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:06.469504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:06.472587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=78 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:06.611563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:06.619806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f49bfdd9-1a52-4cdf-9c55-6ff968982072 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.165367 Sep 28 12:32:06.620391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 627/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:07.643308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:07.643920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:07.646225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=26 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:07.651630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:07.652106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:07.653201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:07.653895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:07.654369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:07.654789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:07.657615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=78 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:07.781404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:07.789978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93311839-638f-4cc6-9479-c5ba7dd97cf6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150447 Sep 28 12:32:07.790549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 603/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:07 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:08.811892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:08.812533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:08.818936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:08.819409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:08.819846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:08.820568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:08.821024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:08.821444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:08.947162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:08.955822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c884decc-187b-46d7-b2c6-d26373005710 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147793 Sep 28 12:32:08.956411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 628/1231] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:08 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:09.979430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:09.980037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:09.986519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:09.986989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:09.987412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:09.988093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:09.988561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:09.988980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:10.123615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:10.131923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a74f37d-d763-4ac4-8e8a-43360c1dd4b6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156566 Sep 28 12:32:10.132527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 604/1232] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:11.155516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:11.156124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:11.162516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:11.162984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:11.163410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:11.164092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:11.164568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:11.165090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:11.288947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:11.297306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-82d8333c-4022-4053-bf2e-aea40cb9d551 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146237 Sep 28 12:32:11.297878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 629/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:12.321122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:12.321702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:12.328040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:12.328551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:12.328979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:12.329659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:12.330099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:12.330517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:12.459120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:12.467804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-60c29da7-c845-4939-9c84-9df0b74cda5c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150877 Sep 28 12:32:12.468390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 605/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:13.491102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:13.491633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:13.498081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:13.498552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:13.498977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:13.499661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:13.500106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:13.500549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:13.624274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:13.632608 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ce1c14c0-09fd-4434-ab07-521117476628 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145441 Sep 28 12:32:13.633179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 630/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:14.655906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:14.656545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:14.662924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:14.663404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:14.663835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:14.664556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:14.665006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:14.665431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:14.793895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:14.802221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88d5a476-c31e-4879-a403-2c1aae986650 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150714 Sep 28 12:32:14.802784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 606/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:14 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:15.825551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:15.826181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:15.832529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:15.833004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:15.833434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:15.834116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:15.834576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:15.835013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:15.968181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:15.976436 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-813262f9-d906-4fa3-94cb-33252609cc12 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154595 Sep 28 12:32:15.977192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 631/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:15 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:17.003321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:17.004249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:17.015164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:17.016005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:17.016809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:17.017762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:17.018218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:17.030038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:17.166443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:17.175109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa865834-509e-4312-af75-dbe79ba88c83 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.177836 Sep 28 12:32:17.175672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 607/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:18.198655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:18.199274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:18.205895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:18.206381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:18.206816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:18.207515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:18.207968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:18.208418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:18.332546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:18.341287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7753354f-d246-4286-b255-79e4e562165c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146452 Sep 28 12:32:18.341852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 632/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:19.364579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:19.365153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:19.371523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:19.371994 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:19.372462 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:19.373145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:19.373592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:19.374007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:19.505990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:19.514880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-855f7730-75de-4469-99cc-644a82289a81 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154295 Sep 28 12:32:19.515441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 608/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:20.537870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:20.538485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:20.545579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:20.546156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:20.546485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:20.547267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:20.547719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:20.548192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:20.677684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:20.686009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-05cf085b-0faa-4f3f-9f6b-ec454030e6d9 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152041 Sep 28 12:32:20.686599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 633/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:21.709087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:21.709700 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:21.716551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:21.717025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:21.717456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:21.718142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:21.718592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:21.719015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:21.846484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:21.854867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71e67368-25c6-4324-b3ff-6e62d89c521a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149541 Sep 28 12:32:21.855440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 609/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:22.878757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:22.879364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:22.885710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:22.886187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:22.887107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:22.887784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:22.888226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:22.888669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:23.015620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:23.023801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d9f84185-b6bc-4233-97e2-9ee747118393 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148860 Sep 28 12:32:23.024382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 634/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:22 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:24.047615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:24.048224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:24.055041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:24.055525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:24.055956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:24.056698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:24.057151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:24.057591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:24.182749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:24.190824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c7929e89-25cc-4daf-80b1-503281fd0423 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147112 Sep 28 12:32:24.191395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 610/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:25.213933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:25.214579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:25.221442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.221920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.222355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.223035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:25.223483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:25.223910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:25.346964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:25.355340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8fd22fa1-9007-400f-8b8c-6c9f40c19b8f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145378 Sep 28 12:32:25.355912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 635/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:26.378395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:26.378995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:26.385355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.385826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.386283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.386961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:26.387399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:26.387809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:26.519835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:26.529219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-00427e1e-c6e6-4b78-9a6a-0f70cc413e53 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154191 Sep 28 12:32:26.530077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 611/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:27.552909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:27.553634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:27.560537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:27.561009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:27.561437 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:27.562127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:27.562570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:27.562989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:27.703093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:27.711367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-298b817a-22d2-44c9-91b9-467c202f3267 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.162237 Sep 28 12:32:27.711951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 636/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:27 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:28.733841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:28.734517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:28.741197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:28.741665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:28.742097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:28.742788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:28.743237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:28.743659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:28.870226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:28.878889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-58cafb82-6370-4470-9340-e190c0c1634e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148835 Sep 28 12:32:28.879458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 612/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:29.901183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:29.902369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:29.908888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:29.909371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:29.909810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:29.910502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:29.910958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:29.911384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:30.035872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:30.044675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-631d907e-1b7e-499b-8086-3e9d7f0adf51 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147305 Sep 28 12:32:30.045263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 637/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:31.066917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:31.067531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:31.073933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:31.074406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:31.074837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:31.075521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:31.075968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:31.076428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:31.206887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:31.215185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c888934-ce2f-4972-a256-6288d0fa9d3b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152109 Sep 28 12:32:31.215792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 613/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:32.238668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:32.239275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:32.245682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.246161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.246588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.247266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:32.247713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:32.248131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:32.373441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:32.381419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-69ba59be-a045-469e-bc87-f158da3b6785 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146606 Sep 28 12:32:32.381990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 638/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:33.405542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:33.406133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:33.412845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.413323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.413761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.414450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:33.414901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:33.415325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:33.687168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:33.695182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e786bb91-7bf9-414a-bab0-8c303c443c44 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.294139 Sep 28 12:32:33.695741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 614/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:34.720205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:34.720872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:34.729321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.730818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.731556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.732803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:34.733599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:34.734340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:34.860037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:34.868160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3942b1ac-40dc-4132-9414-c9ff605a7e4d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152267 Sep 28 12:32:34.868753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 639/1253] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:35.891182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:35.891704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:35.897818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:35.898298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:35.898738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:35.899426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:35.899875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:35.900298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:36.025536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:36.034367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0df21838-4cd6-4569-9da2-3dfd735d0b1e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147086 Sep 28 12:32:36.035233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 615/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:35 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:36.118476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:36.119007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:36.125012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:36.125485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:36.125913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:36.126595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:36.127062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:36.127479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:36.155299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:32:36.212484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [88dbc832-9826-4fb6-8557-a6ec2e07c855] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:32:37.058535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:37.059136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:37.065441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:37.065917 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:37.066351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:37.067038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:37.067506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:37.067925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:37.200177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:37.208182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-66ba6005-ad49-49e8-871e-46c857daa3cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154064 Sep 28 12:32:37.208774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 616/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:37.220975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [88dbc832-9826-4fb6-8557-a6ec2e07c855] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48622. Sep 28 12:32:37.226166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:37.244559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3494d6dd-11a2-477f-8f97-39c5d1adf324 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 204 len: 0 microversion: 2.20 time: 1.129709 Sep 28 12:32:37.245915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 640/1256] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 28 12:32:36 2022] DELETE /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:32:37.254104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:37.254713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:37.260729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:37.261209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:37.261672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:37.262358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:37.262810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:37.263236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:37.393207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:37.401223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:37.402664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:37.403818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb945865-c7e8-4a8c-9737-d4b889fdecc5 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1722 microversion: 2.20 time: 0.153952 Sep 28 12:32:37.404389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 617/1257] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:32:37 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:32:38.232291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:38.233871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:38.241287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:38.241772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:38.242205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:38.242908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:38.243353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:38.244091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:38.247169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:38.429490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:38.430134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:38.433029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=30 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:38.438521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:38.439026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:38.439456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:38.440147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:38.440620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:38.441055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:38.456544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:32:38.560514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:38.568965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-abeaa24f-8bb5-4930-9bda-66e725963d46 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.341323 Sep 28 12:32:38.580742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 641/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:38.581419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:38.590364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:38.592342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:38.594221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c0c17038-1de8-480a-8cb8-af3ad3270a07 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1722 microversion: 2.20 time: 0.168426 Sep 28 12:32:38.595201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 618/1259] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:32:38 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:32:39.344034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6193f7a3-88d5-468f-ab3c-6e94ce08555e", "name": "network-vif-deleted", "tag": "c8f8ac1e-9e76-4e98-84c1-a77ee8423ded"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:32:39.361124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.361677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.362182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.389611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] Creating event network-vif-deleted:c8f8ac1e-9e76-4e98-84c1-a77ee8423ded for instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e on hv-cinder-85919 Sep 28 12:32:39.394908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-48809541-787d-420a-bfb5-f2866c0685fe req-f6ec2e4a-393d-468a-b9b6-4fdea195d79f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132642 Sep 28 12:32:39.395916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 642/1260] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:39.592047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:39.592751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:39.602704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.603273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.603787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.605271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.605948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.606487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.622499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:39.623302 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:39.629991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.630988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.631432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.632624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.633283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.633974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.678107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:39.678924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:39.679561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:39.680219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lazy-loading 'fault' on Instance uuid 6193f7a3-88d5-468f-ab3c-6e94ce08555e {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:32:39.729193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:39.742979 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:39.744592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '820f4bb963644499a77fa1f3edd59d08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba288a6bdc4e41729bd679733eaee61e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:39.745825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0aaa6f09-960f-4908-9da5-e03ad39c5963 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 200 len: 1371 microversion: 2.20 time: 0.128453 Sep 28 12:32:39.746941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 643/1261] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:32:39 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 12:32:39.766560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:39.775342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-87a0909a-49f0-4bce-818a-2aa06d70e28d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.187523 Sep 28 12:32:39.775901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 619/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:40.771177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:40.771714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:40.778211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:40.778683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:40.779117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:40.779801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:40.780249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:40.780696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:40.794152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e HTTP/1.1 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:32:40.795791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:32:40.797722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '6193f7a3-88d5-468f-ab3c-6e94ce08555e'} Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:40.801069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:32:40.802719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:32:40.804228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:40.804228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-401fa7a3-cbdc-4ad9-8ede-17bf518ae4a8 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 404 len: 111 microversion: 2.20 time: 0.030050 Sep 28 12:32:40.804228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 644/1263] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:32:40 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:32:40.804516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:40.804516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:40.805941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9d43b2ec-fce0-4a77-907b-0d8609119754 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '.version_select at 0x7f30626831f0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:40.809901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:40.810405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:40.810838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:40.811192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d43b2ec-fce0-4a77-907b-0d8609119754 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [e74146c9-14e3-4755-a73f-9a13fd211b25] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:32:40.811541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:40.811991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:40.812444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:40.936633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:40.944702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-57e1f9b9-1c32-429f-b36b-9aa122ee7709 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149488 Sep 28 12:32:40.945248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 620/1264] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:40 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:41.818660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d43b2ec-fce0-4a77-907b-0d8609119754 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [e74146c9-14e3-4755-a73f-9a13fd211b25] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48686. Sep 28 12:32:41.837897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9d43b2ec-fce0-4a77-907b-0d8609119754 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661700684" status: 204 len: 0 microversion: 2.20 time: 1.035638 Sep 28 12:32:41.838550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 645/1265] 10.222.0.26 () {60 vars in 1262 bytes} [Wed Sep 28 12:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661700684 => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 12:32:41.967706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:41.968493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:41.977767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:41.978278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:41.978709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:41.979420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:41.979858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:41.980275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:42.224105 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:42.232649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f331ebfc-8abd-48e0-9628-174f5b8e33fe tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.269239 Sep 28 12:32:42.233290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 621/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:41 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:43.257109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:43.257727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:43.264135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:43.264642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:43.265080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:43.265770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:43.266221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:43.266647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:43.395203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:43.403886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eaf43871-665a-40e7-8929-c80da8110963 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151206 Sep 28 12:32:43.404473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 646/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:43 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:44.427107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:44.427707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:44.434188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:44.434668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:44.435104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:44.435790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:44.436240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:44.436691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:44.575401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:44.583558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dffdc4fd-c680-4ebc-8362-69327bfd9be1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160269 Sep 28 12:32:44.584113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 622/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:45.607509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:45.608156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:45.614716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:45.615202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:45.615674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:45.616430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:45.616884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:45.617313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:45.748166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:45.756279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e1028fc0-dec3-4bd9-a539-14bc8fbb5e0b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153067 Sep 28 12:32:45.756871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 647/1269] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:46.778758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:46.779361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:46.785718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:46.786188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:46.786616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:46.787298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:46.787745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:46.788164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:46.917432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:46.925520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3737ffdc-0136-434d-9a31-ac74099d509e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150522 Sep 28 12:32:46.926076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 623/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:47.949626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:47.950240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:47.956764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:47.957243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:47.957680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:47.958366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:47.958818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:47.959245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:48.086267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:48.094396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e65b7b06-5754-42aa-bedc-6dd5fffaf109 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149188 Sep 28 12:32:48.094961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 648/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:47 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:49.117647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:49.118263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:49.124732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:49.125244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:49.125676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:49.126365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:49.126817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:49.127240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:49.251632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:49.259726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d2b03200-349a-4ab6-85c5-e2e24a95f6d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145906 Sep 28 12:32:49.260858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 624/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:49 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:50.283164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:50.283773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:50.290238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:50.290715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:50.291149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:50.292538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:50.292994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:50.293419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:50.421708 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:50.429903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d31bfb99-9bfa-48e5-b3f0-b830cb2917e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150573 Sep 28 12:32:50.430479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 649/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:50 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:50.948264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:50.948804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:50.955132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:50.955606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:50.956034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:50.956752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:50.957202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:50.957625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:50.986215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:32:51.044181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [78cb6ce2-489e-4db4-a641-3c6b9578dea8] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:32:51.454377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:51.454920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:51.461387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:51.461855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:51.462282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:51.462959 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:51.463402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:51.463821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:51.589825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:51.598154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c3f59b0e-69c5-4a4d-a8de-1ed07e3e2cf0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147599 Sep 28 12:32:51.598723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 650/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:52.050336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [78cb6ce2-489e-4db4-a641-3c6b9578dea8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 48830. Sep 28 12:32:52.070277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd62e311-93c0-4aa1-9dd1-b8becdbffe2c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 204 len: 0 microversion: 2.1 time: 1.125640 Sep 28 12:32:52.071235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 625/1275] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:32:50 2022] DELETE /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:32:52.080186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:52.080832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:52.087043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:52.087523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:52.087954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:52.088669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:52.089166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:52.090096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:52.218823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:52.226646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-965ba128-819d-42f2-9c5f-cd20775a0ade tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1674 microversion: 2.1 time: 0.150457 Sep 28 12:32:52.227473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 651/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:52 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:52.622483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:52.623179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:52.629114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:52.629592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:52.630023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:52.630717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:52.631165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:52.631581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:52.763111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:52.771245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-679e1b69-326a-483b-95b5-29a24149ee5e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153550 Sep 28 12:32:52.771802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 626/1277] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:53.251856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:53.252590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:53.259079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:53.259699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:53.260332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:53.261189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:53.261876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:53.262246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:53.446261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb0f345d2e04483b5166e1eb728bf91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f6e096c5a54a7ebc843b012e82e0f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:53.454458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0507fb60-c083-4f40-87ac-c68263fd7b69 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 200 len: 1674 microversion: 2.1 time: 0.206948 Sep 28 12:32:53.455238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 652/1278] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:53 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:53.771512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556dc44e-ec85-4db2-8d42-c203c19a303c", "name": "network-vif-deleted", "tag": "bb5a5d14-ba0b-4795-868c-3c70d3662556"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:32:53.784948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:32:53.785147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:32:53.787052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:32:53.788934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:32:53.800619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:53.801595 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:53.803520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:53.804000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:53.804453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:53.809962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:53.810572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:53.811585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:53.813689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:53.814266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:53.814767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:53.823927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] Creating event network-vif-deleted:bb5a5d14-ba0b-4795-868c-3c70d3662556 for instance 556dc44e-ec85-4db2-8d42-c203c19a303c on hv-cinder-85919 Sep 28 12:32:53.830299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-68e73705-b985-4eeb-873c-f4eb340c6d15 req-6c43fcf1-7602-449f-acbe-87f4dceabe13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063221 Sep 28 12:32:53.831780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 627/1279] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:32:53.975823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:53.985177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-170ec53e-9519-4f04-a5e4-dc5f958a6a82 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.193760 Sep 28 12:32:53.985762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 653/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:54.478269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:54.479383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:54.485839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:54.486623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:54.487310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:54.488255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:54.488807 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:54.489307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:54.504390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c HTTP/1.1 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:32:54.506319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:32:54.508276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '556dc44e-ec85-4db2-8d42-c203c19a303c'} Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:32:54.510541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:32:54.512879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:32:54.514350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:32:54.514350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4ed725c0-50bb-4742-a443-88414b72cb7d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 404 len: 111 microversion: 2.1 time: 0.033858 Sep 28 12:32:54.514350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 628/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:54 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:32:54.519611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-501870d0-fbcc-45b8-9138-45d4837d218e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '.version_select at 0x7f3062438820>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:54.541226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-501870d0-fbcc-45b8-9138-45d4837d218e tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779020517" status: 202 len: 0 microversion: 2.1 time: 0.025376 Sep 28 12:32:54.541813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 654/1282] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 28 12:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779020517 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:32:55.009418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:55.010071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:55.017028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:55.017507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:55.017942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:55.018645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:55.019103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:55.019519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:55.214074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:55.222565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4493d535-3127-430f-a3c7-adccc415309a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.216998 Sep 28 12:32:55.223222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 629/1283] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:56.244018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:32:56.244553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d (ip 10.222.0.26) !!! Sep 28 12:32:56.249358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:56.249971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:56.259654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:56.260139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:56.260693 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:56.261398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:56.261856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:56.262517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:56.394864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:56.403570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6d06bc7d-868e-40c9-993f-288fc8f882df tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160703 Sep 28 12:32:56.404136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 655/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:56 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:57.426868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:57.427480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:57.433920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:57.434340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:57.434777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:57.435471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:57.435932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:57.436394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:57.562346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:57.570407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3c43610-b0d6-4b24-8587-32c7763d1b8b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147470 Sep 28 12:32:57.570967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 630/1285] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:32:58.594165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:58.594776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:58.601146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:58.601617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:58.602309 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:58.602986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:58.603431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:58.603854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:58.732731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:58.740921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-91fe17eb-94e9-48af-8a5c-7d5149913ea0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150577 Sep 28 12:32:58.741720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 656/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:32:59.765115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:32:59.765724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:32:59.773666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:59.774160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:59.774649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:59.775293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:32:59.775748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:32:59.776424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:32:59.912335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:32:59.920705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-731a69bf-bd3c-4b2d-bd94-0564494c4529 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.159999 Sep 28 12:32:59.921448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 631/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:32:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:00.944581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:00.945155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:00.952070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:00.952586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:00.953019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:00.953706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:00.954155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:00.954578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:01.083095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:01.091224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-30a24c32-9b3b-42f3-9bfb-7f37e4a9c31f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150545 Sep 28 12:33:01.091786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 657/1288] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:00 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:02.114550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:02.115142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:02.122239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:02.122714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:02.123139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:02.123823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:02.124328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:02.124747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:02.250398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:02.258480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a2d805f1-4031-4741-8ae6-dd5e1cbdc2c3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147755 Sep 28 12:33:02.259035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 632/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:03.281811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:03.282413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:03.289037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:03.289504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:03.289930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:03.290606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:03.291054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:03.291468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:03.414855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:03.422965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4caa8aa7-06d0-43ac-81c4-48ab2129482b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.144981 Sep 28 12:33:03.423525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 658/1290] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:03 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:04.446758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:04.447355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:04.453710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:04.454187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:04.454616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:04.455299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:04.455748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:04.456169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:04.580486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:04.588709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8765c465-c977-4757-8e60-937b6eaaedd5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146056 Sep 28 12:33:04.589776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 633/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:05.614066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:05.615205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:05.622069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:05.622553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:05.622989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:05.623686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:05.624140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:05.624616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:05.755862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:05.766215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a69d51a7-0ee1-4901-81dd-fc8bb8dde9dc tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.156733 Sep 28 12:33:05.767347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 659/1292] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:06.790637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:06.791254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:06.797557 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:06.798044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:06.798479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:06.799178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:06.799636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:06.800067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:06.815432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:06.936434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:06.944733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3e977644-0e2e-41f2-b0e6-d0a5af5fa8e8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.157867 Sep 28 12:33:06.945297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 634/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:07.850384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:07.850861 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:07.853023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:07.858230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.858707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.859139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.859827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.860270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.860714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.886680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:33:07.890511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:07.969214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:07.969819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2bd80991-c9b8-4ca3-8a63-5bf9c31ff0be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 204 len: 0 microversion: 2.1 time: 0.122781 Sep 28 12:33:07.969947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:07.970055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 660/1294] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:33:07 2022] DELETE /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:33:07.978846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:07.979631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:07.982386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.982915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.983358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.984271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.984763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.985409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.986212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.986697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.987136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:07.987832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:07.988283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:07.988859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:08.116817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:08.125120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6291ae02-d8e4-4a5b-863a-1a0a6bad2fd0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160794 Sep 28 12:33:08.125693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 635/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:07 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:08.133815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:08.142066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ea39fa8f-ce1f-4cc4-ac44-f8c150bd858a tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1683 microversion: 2.1 time: 0.167892 Sep 28 12:33:08.142618 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 661/1296] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:07 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:09.149133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:09.149847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:09.153762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:09.157925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.158506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.159034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.160977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.160977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.160977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.166533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:09.168497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:09.175118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.175926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.189084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.189084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.189084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.189084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.314871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:09.323902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-749059e9-9361-48a9-b100-854c9b36c049 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.178282 Sep 28 12:33:09.324584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 636/1297] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:09.366370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:09.374154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d8685a86-99b7-4da7-990b-17096327a07b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1683 microversion: 2.1 time: 0.211526 Sep 28 12:33:09.374941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 662/1298] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:09 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:09.941548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97720b27-58c6-4839-af0c-7c669c4b841d", "name": "network-vif-deleted", "tag": "81df7b9b-fe09-416e-a329-f2f48b35d24e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:09.955262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:09.956135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:09.957137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:09.976417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] Creating event network-vif-deleted:81df7b9b-fe09-416e-a329-f2f48b35d24e for instance 97720b27-58c6-4839-af0c-7c669c4b841d on hv-cinder-85919 Sep 28 12:33:09.985319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-e36fc45f-31bc-45f4-9e91-e8717d510896 req-019044b6-4dd4-40d7-88d9-f7c2b593557f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047610 Sep 28 12:33:09.986489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 637/1299] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:10.347237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:10.348630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:10.360587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.360587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.360587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.360587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.361006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.361006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.399244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:10.400684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:10.408480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.409054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.409560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.410340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.410887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.411400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.443528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:10.444013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:10.444678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:10.445128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.objects.instance [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lazy-loading 'fault' on Instance uuid 97720b27-58c6-4839-af0c-7c669c4b841d {{(pid=120637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:33:10.499127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:10.504730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:10.510242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9dcc5814-d794-4693-995c-72975c6920d1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 200 len: 1331 microversion: 2.1 time: 0.115276 Sep 28 12:33:10.510932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 638/1300] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:10 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:10.517477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eaefb94c-b651-4686-9318-ccdb80064ccb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.174224 Sep 28 12:33:10.518057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 663/1301] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:10 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:11.532637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:11.533251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:11.539941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.540443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.540900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.541402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:11.542372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.542525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.542701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:11.542946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.548879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.549352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.549815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.550499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:11.550944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:11.551362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:11.565496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d HTTP/1.1 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:33:11.567246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:33:11.569023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '97720b27-58c6-4839-af0c-7c669c4b841d'} Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:33:11.570161 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:33:11.571580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:33:11.573471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:33:11.573471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee5e6bc6-468e-44ff-b68d-f10dde10fcd4 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 404 len: 111 microversion: 2.1 time: 0.040067 Sep 28 12:33:11.573471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 639/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:11 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:33:11.577648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56a91250-93ac-4540-9fdf-7a7b8815b210 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '.version_select at 0x7f30625f8af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:11.606051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56a91250-93ac-4540-9fdf-7a7b8815b210 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789933383" status: 202 len: 0 microversion: 2.1 time: 0.032295 Sep 28 12:33:11.607017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 640/1303] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 28 12:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789933383 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 12:33:11.683908 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:11.692045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f3d60be7-50d6-4fbe-ad9b-e138a29a91f7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154388 Sep 28 12:33:11.692670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 664/1304] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:12.241826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b69d1658-124f-4b01-8d44-5341043656b0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: .version_select at 0x7f3065d61e50>, body: {"keypair": {"name": "tempest-keypair-1098914681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj20e/GRZowAtLLT7t5Y7Be6aQ9QgIaDYrNPxDmCzgSkKyk9MP/9q5Tyxehbiq5CJ1dP4k//0SJuT6D1gMXIgR00XdU28p4X7Hkcr9skwZdX8Yrow9203mYq//9F5D9uw=="}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:12.257552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b69d1658-124f-4b01-8d44-5341043656b0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:33:12.261830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-b69d1658-124f-4b01-8d44-5341043656b0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'key_pairs'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:33:12.283688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b69d1658-124f-4b01-8d44-5341043656b0 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045879 Sep 28 12:33:12.285450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 641/1305] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:33:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:12.715289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:12.715901 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:12.722304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.722780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.723232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.723916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:12.724383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:12.724806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:12.855079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:12.863165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f966c10b-75ed-47b0-8d81-43ca1d83908a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152056 Sep 28 12:33:12.863731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 665/1306] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:13.552218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-715977322", "imageRef": "debf5d04-a7dc-4054-9f9f-18b28756ca8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61173ad2-9eff-4ab1-9b46-07b6bca945cf"}], "security_groups": [{"name": "tempest-securitygroup--1778381968"}], "key_name": "tempest-keypair-1098914681", "user_data": "}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:13.665771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] validate_networks() for [('61173ad2-9eff-4ab1-9b46-07b6bca945cf', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:33:13.892795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:13.893399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:13.900101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:13.900746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:13.901184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:13.902560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:13.903011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:13.903578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.032473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:14.040481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-26b0d046-c6d7-4165-833f-b1d011ea3230 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153630 Sep 28 12:33:14.041341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 666/1307] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:14.077053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:33:14.077497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:33:14.077977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:33:14.078386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:33:14.078826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:33:14.087407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.087881 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.088370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.089753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.090202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.090625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.107109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:33:14.110911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Getting quotas for user 4a8818fd59954480bcff68b9ba52769a and project 81f514e581a3473188c0ca78416919a4. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:33:14.122496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:33:14.124793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='debf5d04-a7dc-4054-9f9f-18b28756ca8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:33:14.175330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e291c8c5-fdf9-428e-9c7b-c1f36059a7d5 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630810 Sep 28 12:33:14.176094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 642/1308] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:33:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:33:14.188153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f81a6617-c20a-47ba-982e-388a3aeb2773 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:14.189136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f81a6617-c20a-47ba-982e-388a3aeb2773 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:14.190694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:14.191197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:14.198697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.199205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.199599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.200324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.200795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.201223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.227310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:33:14.257872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f81a6617-c20a-47ba-982e-388a3aeb2773 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:14.266915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f81a6617-c20a-47ba-982e-388a3aeb2773 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1241 microversion: 2.1 time: 0.082928 Sep 28 12:33:14.267944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 667/1309] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:14 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:14.331806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f8d73275-edf5-4a6d-b3cf-5f28c7f2feec tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 204 len: 0 microversion: 2.1 time: 0.144498 Sep 28 12:33:14.332906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 643/1310] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:33:14 2022] DELETE /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:33:14.342300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:14.343061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:14.349348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.349824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.350254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.350940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:14.351384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:14.351803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:14.495982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:14.504379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-130381d6-cf5d-462e-94c4-910ebd461776 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1598 microversion: 2.1 time: 0.166815 Sep 28 12:33:14.504965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 668/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:15.064528 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:15.065355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:15.072246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.072767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.073210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.073915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.075210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.075652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.202126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:15.210311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a81e9463-7c1a-4d3f-817a-057d3dc28e3d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150379 Sep 28 12:33:15.210879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 644/1312] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:15 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:15.290913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:15.292154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:15.300221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.300746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.301189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.301895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.302539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.302969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.386022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:15.393897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4e6887de-ee48-4a37-9f10-6c5496d2480e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1293 microversion: 2.1 time: 0.108489 Sep 28 12:33:15.394461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 669/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:15 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:15.527862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:15.528497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:15.534264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.534736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.535164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.535853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.536329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.536738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.697725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:15.707414 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36619609-6d99-4527-b90b-0e758b4f05c7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1598 microversion: 2.1 time: 0.183244 Sep 28 12:33:15.708385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 645/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:15.829644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84", "name": "network-vif-deleted", "tag": "22f54f6e-b865-438e-b88a-a3184afa088a"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:15.841299 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:15.841854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:15.842282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:15.856544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] Creating event network-vif-deleted:22f54f6e-b865-438e-b88a-a3184afa088a for instance 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 on hv-cinder-85919 Sep 28 12:33:15.861461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-cb2bce09-1a85-4f44-8108-221842edbf68 req-319b0904-a991-483b-8ff7-2b8ac02201c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035432 Sep 28 12:33:15.862056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 670/1315] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:16.233502 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:16.234140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:16.240630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.241112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.241543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.242243 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.242691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.243116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.417832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:16.418547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:16.418714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:16.425513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.426066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.426760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.427266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08f0f92e-be7e-46d5-bbed-76f147429047 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.197702 Sep 28 12:33:16.427591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.428012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 646/1316] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:16.428152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.428573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.571433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:16.580729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0c6c669d-248d-46c9-828f-3e881e7e4032 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.167617 Sep 28 12:33:16.581852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 671/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:16 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:16.735158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:16.735768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:16.741941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.742441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.743088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.743830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:16.744372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:16.744896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:16.819195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:16.827547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7f8f4871-c5b5-47e1-9fad-27db28c6dff8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.096259 Sep 28 12:33:16.828209 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 647/1318] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:17.326192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53829cee-0c58-44b4-84d2-4f47a4167cdf", "tag": "2ce478a9-16be-4657-b216-da2bf09b2976"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:17.343824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.344494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.345174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.359012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] Creating event network-changed:2ce478a9-16be-4657-b216-da2bf09b2976 for instance 53829cee-0c58-44b4-84d2-4f47a4167cdf on hv-cinder-85919 Sep 28 12:33:17.363226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-e835b446-f538-47eb-8ea0-6f2fc9e91000 req-8184a975-ade0-41f0-9d1c-4d18e3440951 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105918 Sep 28 12:33:17.363822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 672/1319] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:17.450930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:17.451581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:17.458115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.458601 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.459033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.459741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.460194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.460653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.605753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:17.606600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:17.612752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.613234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.613666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.614362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.614813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.615236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.679266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:17.688632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4e1b7a2-a1a8-4eb0-902c-6d447a8345b3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.241457 Sep 28 12:33:17.689353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 648/1320] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:17 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:17.754145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:17.763754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-353fc15f-1f87-44fb-b060-d64fc3be4f6f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.162586 Sep 28 12:33:17.764362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 673/1321] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:17 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:17.849797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:17.850432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:17.856796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.857272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.857698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.858375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:17.858817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:17.859231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:17.920944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:17.928931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c78c32c1-3748-4065-a965-fa802c1f7606 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082994 Sep 28 12:33:17.929499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 649/1322] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:18.716779 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:18.717304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:18.723849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.724360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.724792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:18.725474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.725915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.726334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:18.786497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:18.787206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:18.794164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.794632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.795061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:18.795749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.796193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.796907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:18.857003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:18.865061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ed1eced5-59ef-490c-aef7-030314f62b55 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152753 Sep 28 12:33:18.866359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 674/1323] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:18.926234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:18.933795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-db00a08b-ff05-4009-9634-c4c5d7ef2c0e tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.151077 Sep 28 12:33:18.934348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 650/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:18 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:18.952215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:18.952859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:18.958809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.959280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.959707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:18.960410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:18.960859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:18.961281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:19.022801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:19.032243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5c049679-ce5e-4b61-91af-a07b1321b464 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083864 Sep 28 12:33:19.032833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 675/1325] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:19.888013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:19.888657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:19.895123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:19.895609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:19.896046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:19.896772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:19.897230 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:19.897655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:19.956384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:19.956997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:19.963283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:19.963850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:19.964282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:19.964988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:19.965439 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:19.965875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:20.096257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:20.104083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-96d15270-5d87-4498-9936-db20f8b8391d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.151751 Sep 28 12:33:20.104680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 676/1326] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:19 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:20.109748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:20.110464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:20.113947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:20.116062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:20.116568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:20.116999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:20.117692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:20.118139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:20.118563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:20.126145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4cf08ecb-3b90-46aa-9706-2b7ea68f0af1 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.241911 Sep 28 12:33:20.126949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 651/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:20.183255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:20.191525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-325ab7ce-470e-426d-bd7a-5fa0a4f35a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085399 Sep 28 12:33:20.192092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 677/1328] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:21.127672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:21.128273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:21.134631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.135103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.135533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.136216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.137350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.137770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.149936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:21.150588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:21.158165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.158636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.159062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.159754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.160199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.160642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.163364 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:21.270279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:21.278023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6d130459-a6cb-416a-92ec-bed5ea3a8097 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.154081 Sep 28 12:33:21.278589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 652/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:21 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:21.285340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:21.285960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:21.293681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.294570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.295080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.295793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:21.296251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:21.296706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:21.298167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:21.299583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:21.310347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b27ea4bf-1d2e-40e9-ae3b-d5a8838574a4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.162115 Sep 28 12:33:21.310984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 678/1330] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:21.368469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:21.378205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ae0f12e6-81cb-42fd-8d12-84f96ec03c71 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.098655 Sep 28 12:33:21.378939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 653/1331] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:22.301982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:22.302622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:22.309780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.310257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.310691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.311379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.311826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.312252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.337402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:22.338015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:22.344736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.345218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.345654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.346353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.346808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.347231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.442160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:22.452880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-befb153f-5c79-460a-bdf7-0827b2bc244b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.154662 Sep 28 12:33:22.453471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 679/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:22 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:22.458747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:22.459629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:22.466725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.467487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.468146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.469101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.469621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.470109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.482284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:22.493059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c6c4c029-6df9-43bb-9f7a-3b870daa2fd2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.159402 Sep 28 12:33:22.508617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 654/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:22 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:22.540650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:22.549606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7a4b8f7b-16da-4b36-8a0c-0c57021b653d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.094932 Sep 28 12:33:22.550176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 680/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:22.671154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53829cee-0c58-44b4-84d2-4f47a4167cdf", "name": "network-vif-plugged", "status": "completed", "tag": "2ce478a9-16be-4657-b216-da2bf09b2976"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:22.681446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:22.681920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:22.682347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:22.694029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] Creating event network-vif-plugged:2ce478a9-16be-4657-b216-da2bf09b2976 for instance 53829cee-0c58-44b4-84d2-4f47a4167cdf on hv-cinder-85919 Sep 28 12:33:22.699493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b6f8e7d2-de6f-4af4-9862-bf4f99b845fd req-8dd18331-3ac5-49a1-b4ad-ebf3207df620 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090238 Sep 28 12:33:22.700077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 655/1335] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:23.475999 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:23.476625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:23.483805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.484275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.484734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.485419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.485864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.486283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.518028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:23.518758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:23.525005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.525483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.525926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.526621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.527744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.528174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.618122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:23.625892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b37000c0-31e4-4a78-8a3a-d139154183f1 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.153671 Sep 28 12:33:23.626490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 681/1336] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:23 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:23.631026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:23.631631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:23.638625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.639109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.639548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.640247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:23.640733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:23.641158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:23.663308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:23.671515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6fab979c-28e5-469c-8e4d-250d359a65e6 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158079 Sep 28 12:33:23.672083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 656/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:23 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:23.703634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:23.711794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-101533a6-f8d7-469a-bb1b-2dfaa3d1a351 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084372 Sep 28 12:33:23.712396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 682/1338] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:24.651618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:24.651618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:24.655225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:24.655860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:24.660845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.661323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.661757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.662452 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.662900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.663372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.694911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:24.695533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:24.697526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:24.709362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.710814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.712034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.712882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.714154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.716186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.813365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:24.821043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d83ca6bc-f7a7-44ee-b1a5-4fdc961779da tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1367 microversion: 2.1 time: 0.173894 Sep 28 12:33:24.821859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 657/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:24 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:24.827104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:24.827734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:24.833643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.834334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.834770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.835468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:24.835921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:24.836437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:24.858866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:24.867110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0f27f0b2-ef1b-4d8c-9044-7bb9e3f34d61 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.176223 Sep 28 12:33:24.867688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 683/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:24.901254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:24.909998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37e05803-6752-40e7-881c-98c175c8492b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086543 Sep 28 12:33:24.910556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 658/1341] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:25.844050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:25.844691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:25.851101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:25.851581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:25.852019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:25.852984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:25.853438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:25.853863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:25.890045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:25.890654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:25.897160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:25.897637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:25.898069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:25.898768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:25.899218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:25.899642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:25.983625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:25.991536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ee176ae9-ae7d-4034-939a-a2fad15346aa tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1558 microversion: 2.1 time: 0.151512 Sep 28 12:33:25.992295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 684/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:25 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:26.009829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:26.010619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:26.016712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:26.017186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:26.017645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:26.018392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:26.018867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:26.019323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:26.028261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:26.036552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03ff49f0-fe89-4f1a-974f-3b5b4471171b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150167 Sep 28 12:33:26.037118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 659/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:26.041716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:26.042149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:26.048392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:26.048872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:26.049303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:26.049998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:26.050478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:26.050901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:26.081184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:26.089406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a7dac4f-f875-4ef5-8e8c-d4cd3b9c90d4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084050 Sep 28 12:33:26.089977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 685/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:26.126759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4117ca0d-6721-4fa3-b96a-0bb91690d5bb tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088594 Sep 28 12:33:26.127384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 660/1345] 10.222.0.26 () {58 vars in 1275 bytes} [Wed Sep 28 12:33:26 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:33:27.061254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:27.061869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:27.068248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:27.068754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:27.069188 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:27.069864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:27.070320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:27.070743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:27.112844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:27.113447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:27.119529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:27.120016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:27.120960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:27.121745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:27.122194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:27.122617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:27.208728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:27.215576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:27.217217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-13841677-6c5a-431c-b002-09a117affbb3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160430 Sep 28 12:33:27.217806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 686/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:27 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:27.223962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-48a8ced7-0d44-4710-9455-f6303f6b42b7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.115532 Sep 28 12:33:27.224856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 661/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:27.332577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53829cee-0c58-44b4-84d2-4f47a4167cdf", "tag": "2ce478a9-16be-4657-b216-da2bf09b2976"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:33:27.342139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:27.342690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:27.343195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:27.354714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] Creating event network-changed:2ce478a9-16be-4657-b216-da2bf09b2976 for instance 53829cee-0c58-44b4-84d2-4f47a4167cdf on hv-cinder-85919 Sep 28 12:33:27.360616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-8c45e579-14b0-47f6-9fa6-ca23031b0091 req-7b9dcf2f-b466-4a67-8426-2cdb7c8e130a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031640 Sep 28 12:33:27.361596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 687/1348] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:33:28.241195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:28.242083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:28.247432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:28.248137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:28.248496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:28.248976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:28.249414 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:28.250112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:28.250560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:28.250980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:28.256559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:28.257069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:28.257501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:28.258401 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:28.258851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:28.259270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:28.325631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:28.335053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-61de739a-df81-48c8-8b6a-8794e174be97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.091745 Sep 28 12:33:28.335689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 688/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:28.393046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:28.401233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b70141bb-4517-41d4-8615-a99f605eaee5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.163865 Sep 28 12:33:28.401872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 662/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:29.359274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:29.359880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:29.366423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:29.366898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:29.367325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:29.368005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:29.368487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:29.368912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:29.424695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:29.425316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:29.428208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:29.431882 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:29.432388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:29.432826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:29.433522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:29.433975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:29.434403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:29.436402 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2bb21e2f-fa5d-4dc3-be68-623419b02bcd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081632 Sep 28 12:33:29.436970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 689/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:29.559131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:29.567592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-898a688e-692f-4f1d-bb5f-cf85580a2261 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146815 Sep 28 12:33:29.568158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 663/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:30.458927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:30.459531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:30.466516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:30.466988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:30.467413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:30.468092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:30.468561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:30.468980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:30.528883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:30.537230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9b2d36b2-b99f-43b3-beff-0fe167814362 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082078 Sep 28 12:33:30.537737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 690/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:30.591212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:30.591819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:30.599417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:30.599908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:30.600364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:30.601075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:30.601531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:30.601959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:30.729772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:30.737969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f6e344af-be2d-4acd-a155-99e57848d4cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150647 Sep 28 12:33:30.738559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 664/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:30 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:31.559659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:31.560294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:31.566762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.567238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.567671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.568397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.568849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.569275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.632572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:31.640776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-20ccc745-9b71-4d7d-aefc-88fe15273f1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084945 Sep 28 12:33:31.641340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 691/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:31.763967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:31.764547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:31.770997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.771475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.771909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.772636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:31.773088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:31.773526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:31.904231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:31.912491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-11314278-1817-46bc-a3e2-775ee57d6aed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153131 Sep 28 12:33:31.913058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 665/1356] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:32.663932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:32.664569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:32.671512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:32.671983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:32.672451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:32.673164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:32.673607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:32.674023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:32.734036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:32.742455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-59e3a150-acbb-4345-80a0-be85e16a7dde tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082541 Sep 28 12:33:32.743020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 692/1357] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:32.935732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:32.936368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:32.942613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:32.943088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:32.943518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:32.944226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:32.944691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:32.945119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:33.073244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:33.081492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85516bfe-3b5a-4d09-9b60-d9ccd3febc7b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149659 Sep 28 12:33:33.082058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 666/1358] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:33.766419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:33.766958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:33.773362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:33.773831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:33.774258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:33.774932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:33.775376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:33.775793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:33.835209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:33.843649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ece3d5bc-99e2-44fc-afd3-d773c96dc5b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081161 Sep 28 12:33:33.844207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 693/1359] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:34.105934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:34.106548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:34.112982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:34.113466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:34.113907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:34.114604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:34.115060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:34.115489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:34.243504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:34.252233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7eb86269-7032-4d47-b13e-0e302071a849 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151196 Sep 28 12:33:34.252828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 667/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:34.866745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:34.867366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:34.873973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:34.874452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:34.874894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:34.875587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:34.876078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:34.876550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:34.943760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:34.952543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-782c00df-27a7-4531-b267-2b0ab0f7572f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089688 Sep 28 12:33:34.953106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 694/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:35.274966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:35.275576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:35.277772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:35.282908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:35.283384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:35.283815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:35.284529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:35.284981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:35.285405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:35.413246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:35.421391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5d0e7425-381c-4fd2-998f-524777919ee4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150275 Sep 28 12:33:35.421965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 668/1362] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:35 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:35.976026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:35.976670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:35.984523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:35.985072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:35.985720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:35.986870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:35.987374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:35.987803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:36.002833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:36.052046 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:36.060167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3ea67e2d-a196-4e28-89b7-393ed280dcbe tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.088083 Sep 28 12:33:36.060751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 695/1363] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:36.445835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:36.446442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:36.453695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:36.454206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:36.454640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:36.455328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:36.455778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:36.456204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:36.583017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:36.591841 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c52ad03-e049-4df5-908d-00c3b5b7d957 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149984 Sep 28 12:33:36.592467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 669/1364] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:36 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:37.084096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:37.084736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:37.091136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:37.091612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:37.092045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:37.092768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:37.093218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:37.093643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:37.153206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:37.161182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d68e83ad-136a-4b38-8d99-de4a1e504358 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081431 Sep 28 12:33:37.161750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 696/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:37.615877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:37.616539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:37.623002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:37.623476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:37.623903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:37.624619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:37.625061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:37.625478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:37.755457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:37.757708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:37.765440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3dbc03ca-156b-4c0e-82e4-aa14dcfeef2d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153416 Sep 28 12:33:37.766017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 670/1366] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:38.184338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:38.184969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:38.187271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:38.192540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:38.193018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:38.193453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:38.194143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:38.194597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:38.195030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:38.255561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:38.263596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-208afdab-e4fe-4c80-bc2d-ac6ab9c5b1a0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083116 Sep 28 12:33:38.264160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 697/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:38.789019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:38.789621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:38.796553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:38.797029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:38.797456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:38.798145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:38.798775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:38.799199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:38.924703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:38.933373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9b980fcb-e63b-4e8f-95c1-74ceb67d195b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147643 Sep 28 12:33:38.933948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 671/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:39.287256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:39.287868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:39.295348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:39.295829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:39.296265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:39.296994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:39.297452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:39.297875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:39.357764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:39.365852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-25218e45-f439-4fcb-8ee6-eeed9c35911c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082758 Sep 28 12:33:39.366413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 698/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:39.958033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:39.958649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:39.965603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:39.966082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:39.966516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:39.967214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:39.967670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:39.968100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:40.097374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:40.105790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd6a1cb9-4627-4099-b0f1-ab14fa0bdad7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151626 Sep 28 12:33:40.106361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 672/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:40.389681 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:40.390248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:40.396669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:40.397148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:40.397583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:40.398268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:40.398719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:40.399145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:40.460836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:40.468929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-568eb72c-77fb-4d0e-8431-3a2b1083a0db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083781 Sep 28 12:33:40.469499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 699/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:41.128812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:41.129432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:41.135752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:41.136232 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:41.136692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:41.137378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:41.137826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:41.138247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:41.264682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:41.272735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-452d6dd5-215e-41d5-8cee-1d790e206e0f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147722 Sep 28 12:33:41.273301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 673/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:41 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:41.491635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:41.492173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:41.498684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:41.499163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:41.499594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:41.500283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:41.500771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:41.501195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:41.562443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:41.570527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-367bcea7-3088-40d3-af3f-c5eb326d1612 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082870 Sep 28 12:33:41.571103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 700/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:42.297271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:42.297880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:42.304229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.304735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.305166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.305854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.306300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.306719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.436874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:42.444895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-279efcaa-dcb7-4350-9d89-b590b81d0911 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151505 Sep 28 12:33:42.445490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 674/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:42 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:42.594273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:42.594854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:42.601197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.601677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.602103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.603033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:42.603479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:42.603895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:42.664815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:42.673523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c091159f-fb90-4fae-a323-3e950e4ec392 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083450 Sep 28 12:33:42.674088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 701/1375] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:43.469231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:43.469837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:43.476249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.476757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.477444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.478128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.478580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.479007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.605354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:43.613526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7bd22cd-e08a-49db-a06b-c5521f2144c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148227 Sep 28 12:33:43.614101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 675/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:43 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:43.695118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:43.695722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:43.702725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.703200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.703631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.704337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:43.704787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:43.705207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:43.764990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:43.773215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fdacff8c-7bf8-4c31-94bb-df106fb372b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081861 Sep 28 12:33:43.773778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 702/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:44.637373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:44.638007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:44.644628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.645111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.645538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.646226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.646679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.647103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.774993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:44.783894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff574b6c-7bfe-4514-9ebe-79fa998122ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150907 Sep 28 12:33:44.784492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 676/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:44.797009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:44.797759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:44.804117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.804618 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.805049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.805729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:44.806174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:44.806597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:44.874215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:44.882313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5b71ebad-2422-411f-a5f2-c450a6421374 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.091159 Sep 28 12:33:44.882874 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 703/1379] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:45.806942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:45.807553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:45.814256 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:45.814735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:45.815171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:45.815869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:45.816347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:45.816783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:45.905684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:45.906312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:45.912702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:45.913177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:45.913607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:45.914298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:45.914743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:45.915165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:45.946413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:45.954769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-74ac6a3a-a39c-4a21-9e07-e2cbf30f2e96 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151674 Sep 28 12:33:45.955356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 677/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:45.975137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:45.984247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3e9f41fc-7b14-444f-8b45-88cadc0bebeb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082868 Sep 28 12:33:45.984840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 704/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:46.977694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:46.978292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:46.985090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:46.985565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:46.985991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:46.986672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:46.987116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:46.987541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:47.006683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:47.007298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:47.014147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:47.014623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:47.015059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:47.015753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:47.016207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:47.016679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:47.076877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:47.085068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-19526f85-df5e-42ae-8753-b63d9442161f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082231 Sep 28 12:33:47.085898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 705/1382] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:47.114295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:47.122956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b3dab78c-4609-442b-aa4f-743c143d933a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149356 Sep 28 12:33:47.123525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 678/1383] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:48.109516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:48.110061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:48.116580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.117056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.117490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.118178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.118630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.119052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.146903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:48.147517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:48.154409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.154889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.155324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.156019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:48.156506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:48.156935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:48.178798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:48.186982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ee7b5290-65cf-4551-b727-8111ab0bcb7b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081360 Sep 28 12:33:48.187550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 706/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:48.285934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:48.294211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c37949a-487c-436f-bd0d-7430c01462a3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151214 Sep 28 12:33:48.294778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 679/1385] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:48 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:33:49.209599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:49.210209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:49.216573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.217051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.217480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.218158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.218602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.219019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.281347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:49.289386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6cbbbd3a-2b27-4d58-93f3-970b22f2da8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083717 Sep 28 12:33:49.289947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 707/1386] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:49.317017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:49.317648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:49.323992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.324503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.324933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.325616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:49.326062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:49.326481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:49.454676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:49.462720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab930461-1205-4c12-8080-f4278fa92973 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149437 Sep 28 12:33:49.463227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 680/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:49 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:50.313202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:50.313818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:50.320429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.320916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.321377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.322070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.322522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.323574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.382843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:50.391954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2b1d7cd5-8338-406c-8362-d78e5e5a082e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082594 Sep 28 12:33:50.392621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 708/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:50.486178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:50.486795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:50.493378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.493855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.494291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.495718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:50.496079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:50.496539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:50.625135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:50.633438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-284f3186-c77e-498d-9b3b-a1cf309091bb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151062 Sep 28 12:33:50.634040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 681/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:50 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:51.414868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:51.415482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:51.421959 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.422457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.422880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:51.423573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.424029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.424768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:51.484574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:51.493005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-093e6fcf-ffc2-4dfa-9134-6311c2c0108c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082008 Sep 28 12:33:51.493584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 709/1390] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:51.656066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:51.656702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:51.663163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.663638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.664075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:51.664802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:51.665307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:51.665690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:51.795198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:51.804492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc4c4dad-8b2e-4cb3-93fa-c183609f2a7a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152168 Sep 28 12:33:51.805087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 682/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:52.515346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:52.515955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:52.522341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:52.522813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:52.523240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:52.523922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:52.524396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:52.524819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:52.583974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:52.592576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b4790770-0922-4855-b5cb-759265b894bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081076 Sep 28 12:33:52.593141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 710/1392] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:52.827448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:52.828056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:52.834421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:52.834891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:52.835320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:52.835999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:52.836478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:52.836897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:52.968510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:52.976880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-204b0b35-18e9-4052-b62f-ae57810363d7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153758 Sep 28 12:33:52.977713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 683/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:53.616035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:53.616706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:53.623609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:53.624086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:53.624554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:53.625242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:53.625702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:53.626123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:53.689101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:53.697289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2481d926-a145-485c-82cf-e76a352ed274 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085165 Sep 28 12:33:53.697873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 711/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:53.999926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:54.000570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:54.006936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.007415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.007842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.008552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.009002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.009423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.137943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:54.145961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a5d2b82a-2f6e-4458-8358-5d97c04ecf1c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149838 Sep 28 12:33:54.146523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 684/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:54.719630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:54.720239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:54.726668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.727139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.727835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.728545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:54.728992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:54.729409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:54.731929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:54.791697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:54.799817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-95ea2f04-abbb-46db-8eaa-eddbe59e6106 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084026 Sep 28 12:33:54.800413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 712/1396] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:55.170299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:55.170876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:55.177271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.177748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.178182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.178877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.179336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.179763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.303435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:55.312625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-237418d4-f663-4509-98cf-da2c6541600a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147002 Sep 28 12:33:55.313201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 685/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:55.823429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:55.824040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:55.830528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.831008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.831441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.832127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:55.832606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:55.833032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:55.894067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:55.902834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00a31ef3-d440-457d-9398-b6296561ee0d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083724 Sep 28 12:33:55.903395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 713/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:56.335611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:56.336224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:56.343295 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.343778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.344211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.344929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.345384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.345809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.475894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:56.485441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f65f4073-c0fa-4324-a6ce-93652067c33e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153673 Sep 28 12:33:56.486013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 686/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:56 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:56.925496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:56.926135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:56.932582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.933055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.933489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.934174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:56.934620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:56.935041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:56.995549 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:57.003834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-31dbf64f-0284-45b7-9dc0-5625301434ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082235 Sep 28 12:33:57.004423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 714/1400] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:57.508539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:57.509140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:57.515658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:57.516136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:57.516585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:57.517266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:57.517710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:57.518130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:57.532394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:33:57.647398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:57.656436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-206d6b06-853c-4fbb-b480-b68433c679e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151773 Sep 28 12:33:57.657096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 687/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:58.027181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:58.027808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:58.034271 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:58.034750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:58.035195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:58.035892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:58.036368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:58.036801 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:58.099177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:58.107532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8e941713-325c-4ebc-b283-138363e2864a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084866 Sep 28 12:33:58.108106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 715/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:58.681141 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:58.681748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:58.688933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:58.689421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:58.689889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:58.690587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:58.691047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:58.691478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:58.817586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:58.825875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42741b2e-5b92-4faf-b3b3-e4d2ee9a0232 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148607 Sep 28 12:33:58.826448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 688/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:59.130568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:59.131174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:59.137582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.138050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.138477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.139152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.139596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.140010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.199174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:33:59.207353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bbfeedd9-3640-4eae-843a-7253bfa1ffa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080587 Sep 28 12:33:59.207933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 716/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:33:59.849323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:33:59.849938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:33:59.857754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.858489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.859149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:33:59.860205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:33:59.860939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:33:59.861625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:00.001544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:00.009732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-02fe4a0c-7f59-4294-b895-2ddc47e6204f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.164253 Sep 28 12:34:00.010906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 689/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:33:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:00.231471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:00.232043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:00.238412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:00.238886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:00.239322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:00.240010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:00.240498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:00.240917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:00.300203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:00.308945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e3bacbea-df16-4c93-bf8d-c6f19be55e26 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082311 Sep 28 12:34:00.309514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 717/1406] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:01.033434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:01.034044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:01.040382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.040856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.041310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.042456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.043133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.043796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.168014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:01.176090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86e9f6c3-ea01-46c5-b860-3c6ae4524b54 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146546 Sep 28 12:34:01.176686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 690/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:01 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:01.331009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:01.331565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:01.337942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.339004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.339435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.340117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:01.340587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:01.341007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:01.400091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:01.408117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-eb72677e-51b9-4997-b665-1d4b02ee8948 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080976 Sep 28 12:34:01.408715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 718/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:02.199020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:02.199566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:02.207273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:02.207753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:02.208183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:02.208916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:02.209362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:02.209785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:02.339183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:02.347338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5777875-5990-44ae-8a31-4c4ab206e82e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152289 Sep 28 12:34:02.347907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 691/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:02.429853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:02.430477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:02.436966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:02.437446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:02.437880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:02.438658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:02.439112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:02.439543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:02.505241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:02.514097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00c5edd0-d516-43ba-a9f8-824bcbef1ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.088082 Sep 28 12:34:02.514670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 719/1410] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:03.371913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:03.372545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:03.379089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:03.379592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:03.380019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:03.380749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:03.381222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:03.381644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:03.510239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:03.518455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3728aafa-964c-4c35-a2be-bdb9d8abe74b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151018 Sep 28 12:34:03.519057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 692/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:03 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:03.537394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:03.538041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:03.544991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:03.545470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:03.545906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:03.546594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:03.547042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:03.547466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:03.608335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:03.616393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-12b1a6f0-9999-4ab7-adc7-d89cbe780d2e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082808 Sep 28 12:34:03.616961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 720/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:04.541750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:04.542394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:04.548830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.549305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.549732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.550412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.550858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.551277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.639736 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:04.640495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:04.646938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.647420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.647858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.648591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:04.649043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:04.649469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:04.676825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:04.685577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3662bc92-9a1d-46c2-9d86-fc7be8e6f260 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147926 Sep 28 12:34:04.686145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 693/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:04.709270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:04.717380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bd0f31fe-d503-40ec-a48e-d7eee23ae98b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082110 Sep 28 12:34:04.717945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 721/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:05.709195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:05.709796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:05.712108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=52 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:05.718644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:05.719127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:05.719563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:05.720290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:05.720773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:05.721229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:05.740651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:05.741265 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:05.747432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:05.747850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:05.748292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:05.749003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:05.749460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:05.749890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:05.812787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:05.821118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7a735abf-0530-4c07-a785-b3d0aa0b250e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084184 Sep 28 12:34:05.821690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 722/1415] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:05.858322 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:05.866408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca478600-6eba-4bd1-954e-b60d095d0656 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.161015 Sep 28 12:34:05.866974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 694/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:06.844865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:06.845460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:06.851662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:06.852134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:06.852858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:06.853542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:06.854011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:06.854451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:06.889620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:06.890522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:06.897337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:06.897817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:06.898244 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:06.898944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:06.899392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:06.899812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:06.920113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:06.928329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-472c8283-c2c3-44c1-9299-ba5d164b52f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087285 Sep 28 12:34:06.929105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 723/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:07.029926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:07.038115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1155f278-4048-4eff-9ae0-1b9fc6ea55a0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152434 Sep 28 12:34:07.038680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 695/1418] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:07.950095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:07.950709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:07.957200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:07.957679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:07.958113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:07.958798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:07.959250 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:07.959674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:08.020649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:08.028855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-041ba2b6-239d-4544-86a8-e8a0a164aa45 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082631 Sep 28 12:34:08.029418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 724/1419] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:08.062081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:08.062622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:08.068912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:08.069388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:08.069817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:08.070498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:08.070945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:08.071364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:08.199202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:08.207356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7d4bba87-43c8-4f99-b7c8-89d69cdf5d69 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149763 Sep 28 12:34:08.207927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 696/1420] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:08 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:09.052063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:09.052683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:09.054991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=56 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:09.060680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:09.061611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:09.062405 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:09.063358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:09.063814 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:09.064241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:09.124329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:09.132445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1833dda6-a2d4-4ba9-8338-05a5d3b39f36 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084509 Sep 28 12:34:09.133013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 725/1421] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:09.232017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:09.232631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:09.238957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:09.239429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:09.239855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:09.240577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:09.241035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:09.241450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:09.365351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:09.374104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-588dfd64-887a-44cb-854a-f4b9ea0c2d28 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146745 Sep 28 12:34:09.374664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 697/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:10.158543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:10.159100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:10.165487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.165969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.166403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.167085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.167533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.167955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.227771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:10.235892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-48e65052-738a-4add-8370-a99cc038ba6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081293 Sep 28 12:34:10.236493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 726/1423] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:10.396644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:10.397247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:10.403686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.404158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.404691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.405374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:10.405821 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:10.406242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:10.537704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:10.545924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7971469e-5203-465a-b46f-b10144d6a832 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153082 Sep 28 12:34:10.546499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 698/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:10 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:11.258476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:11.259165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:11.265519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.265997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.266527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.267213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.267662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.268083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.331286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:11.339975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9e0458dd-ef90-4166-811e-d6c2cd5851bc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085367 Sep 28 12:34:11.340576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 727/1425] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:11.568418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:11.569018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:11.575949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.576455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.576886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.577566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:11.578014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:11.578434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:11.715333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:11.723484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bfa7c0f9-81b7-4f9a-8d0f-00a11825b20c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158918 Sep 28 12:34:11.724337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 699/1426] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:12.363593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:12.364206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:12.371292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.371761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.372190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.372897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.373347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.373768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.431973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:12.434946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:12.442174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-39cf4a3b-c6ad-4bfa-939c-fff0317b43e9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082461 Sep 28 12:34:12.442737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 728/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:12.747535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:12.748097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:12.754470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.754946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.755378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.756093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:12.756580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:12.757006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:12.881368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:12.889458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-38306d87-265e-487f-be7e-d9c891c63815 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146015 Sep 28 12:34:12.890026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 700/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:13.465301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:13.465932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:13.472213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.472691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.473119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.473797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.474238 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.474657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.536180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:13.544348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1f542c94-e7d3-4297-9215-ac5a1c3be6cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083098 Sep 28 12:34:13.544910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 729/1429] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:13.912992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:13.913609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:13.920538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.921069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.921486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:13.922173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:13.922625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:13.923045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:14.050440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:14.059125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd8ed65c-22f2-42b2-9b44-d459c08aab04 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150001 Sep 28 12:34:14.059686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 701/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:14.567869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:14.568519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:14.575399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:14.575872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:14.576300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:14.577010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:14.577459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:14.577883 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:14.640743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:14.648847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-73a09a91-6369-4b8c-911e-585104da497f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084800 Sep 28 12:34:14.649411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 730/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:15.082011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:15.082599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:15.089081 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:15.089561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:15.089995 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:15.090701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:15.091135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:15.091558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:15.217495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:15.225929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7c2f715-3f87-471f-95f8-afa03ed16abd tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147812 Sep 28 12:34:15.226491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 702/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:15 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:15.672791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:15.673394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:15.679699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:15.680170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:15.680626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:15.681307 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:15.681750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:15.682167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:15.743876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:15.751978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-da3009fb-b488-41d7-bb74-daba54153b56 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082932 Sep 28 12:34:15.752513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 731/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:16.251076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:16.251686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:16.258101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.258574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.259003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.259694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.260147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.261093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.390284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:16.398475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-961fea51-9b59-4a82-bf7a-1ee65924785c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151228 Sep 28 12:34:16.399043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 703/1434] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:16.774822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:16.775385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:16.781857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.782337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.782776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.783471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:16.783923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:16.784369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:16.843648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:16.851898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-85bdc3ea-58e3-4fef-b30e-56aa308a74a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081019 Sep 28 12:34:16.852769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 732/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:17.422010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:17.422639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:17.429118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.429591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.430020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.430708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.431167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.431574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.434132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:17.560573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:17.568712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9df25337-025f-495f-b2e4-775235cd954f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150575 Sep 28 12:34:17.569274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 704/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:17 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:17.875482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:17.876124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:17.882552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.883025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.883458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.884141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:17.884623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:17.885047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:17.944232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:17.952884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5303f7c6-ca1b-4b66-a98a-d90abb681f19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081333 Sep 28 12:34:17.953449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 733/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:18.592410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:18.593018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:18.599303 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.599774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.600202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:18.600910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.601358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.601773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:18.728476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:18.737245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80cb0f0f-4157-4d04-b737-fa2f9ff036a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149186 Sep 28 12:34:18.737802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 705/1438] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:18.975324 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:18.975942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:18.983264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.983742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.984174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:18.984903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:18.985355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:18.985784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:19.048543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:19.056809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-11e09bae-5e11-4228-9722-e2a58a32435f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085414 Sep 28 12:34:19.057393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 734/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:19.760479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:19.761051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:19.767399 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:19.767867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:19.768296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:19.769008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:19.769453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:19.769873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:19.897950 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:19.906055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1dedac74-38b6-4b8f-b2e7-5e6106c66eff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149501 Sep 28 12:34:19.906619 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 706/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:20.079592 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:20.080198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:20.086644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.087116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.087540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:20.088218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.089210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.089627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:20.150916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:20.159529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ecf7d703-2f64-4ff2-915c-bbf8594d9669 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083693 Sep 28 12:34:20.160111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 735/1441] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:20.928824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:20.929432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:20.936465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.936943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.937372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:20.938057 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:20.938502 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:20.938921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:21.067104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:21.075773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-29b61e9a-3ad1-49e9-a1e2-ee3ab3cf2cba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150804 Sep 28 12:34:21.076361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 707/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:21.183857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:21.184428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:21.190831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:21.191311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:21.191747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:21.192459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:21.192915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:21.193341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:21.253663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:21.261700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-74ca8a17-728a-44f8-973d-354549d8ff93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082242 Sep 28 12:34:21.262258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 736/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:22.098593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:22.099140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:22.105842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.106318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.106752 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.107439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.107909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.108332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.234889 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:22.242986 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-67ddf404-12c4-4b03-ad0f-ede8d88b5d6c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148391 Sep 28 12:34:22.243552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 708/1444] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:22 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:22.284033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:22.284664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:22.290916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.291384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.291841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.292545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:22.292991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:22.293408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:22.352897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:22.360990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e786abd1-eafc-4844-925b-b06f62458553 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080738 Sep 28 12:34:22.361550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 737/1445] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:23.266066 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:23.266677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:23.273145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.273624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.274060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.274750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.275204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.275631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.388776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:23.389911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:23.395830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.396321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.396766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.397461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:23.397903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:23.398322 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:23.407330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:23.415449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-18a78f41-a7aa-434e-acd6-9db19e1fa1ea tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153225 Sep 28 12:34:23.416021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 709/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:23 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:23.457893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:23.466345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d33a204b-a015-431b-bbe6-bd33a0bbc8d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083586 Sep 28 12:34:23.466902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 738/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:24.439475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:24.440087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:24.446529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.447003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.447433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.448119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.448597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.449020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.490619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:24.491253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:24.498671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.499219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.499714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.500510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:24.501030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:24.501517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:24.565656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:24.573976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-06303264-7b5b-4c35-a6d3-a4d9d6ce4ec4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087485 Sep 28 12:34:24.574797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 739/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:24.581962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:24.590720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64f1c956-1567-4987-aeff-69b2cbcf78b4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155045 Sep 28 12:34:24.591217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 710/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:25.597409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:25.598018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:25.604737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.605206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.605632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.606313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.606753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.607168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.614707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:25.615328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:25.622309 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.622788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.623227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.623928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:25.624411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:25.624872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:25.669939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:25.678170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-52147c7a-763a-432e-acb5-689dbfe8d804 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084657 Sep 28 12:34:25.678742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 740/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:25.751987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:25.760080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-597b8107-4838-4f49-a347-eeccd09764ab tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149409 Sep 28 12:34:25.760714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 711/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:26.702074 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:26.702692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:26.709175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.709656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.710094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.710786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.711240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.711674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.771200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:26.779887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5beddb28-621f-42a7-980a-8e0f40ff6e8f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082321 Sep 28 12:34:26.780491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 741/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:26.783128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:26.783743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:26.790149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.790626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.791056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.791747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:26.792199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:26.792654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:26.918177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:26.926345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2b3c81c5-8d90-44b7-8fbf-a6efa6b3d3ec tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147090 Sep 28 12:34:26.926909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 712/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:27.801967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:27.802572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:27.809092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:27.809558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:27.810053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:27.810732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:27.811275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:27.811695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:27.872755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:27.881028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-74ef7ff4-9710-4e46-99fd-4fe3539b6e2a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082955 Sep 28 12:34:27.881588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 742/1454] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:27.949908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:27.950516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:27.957017 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:27.957490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:27.957921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:27.958598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:27.959047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:27.959467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:28.088872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:28.097593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6961747f-a695-4d7f-9e2a-051dea61ffca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151993 Sep 28 12:34:28.098154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 713/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:27 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:28.902945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:28.903583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:28.909987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:28.910512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:28.910953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:28.911642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:28.912087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:28.912536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:28.980743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:28.989442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-aa912fb0-3ddf-4458-8542-a91ff4b61beb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.090338 Sep 28 12:34:28.990001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 743/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:29.120414 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:29.121163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:29.127623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:29.128099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:29.128566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:29.129255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:29.129709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:29.130133 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:29.255022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:29.263146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0dbb8859-f66a-45ab-aebf-7a0a62f22090 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146580 Sep 28 12:34:29.263705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 714/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:30.013561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:30.014167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:30.021162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:30.021839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:30.022274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:30.022988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:30.023432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:30.023853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:30.083310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:30.091443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-85fb72c6-9bfe-42a2-938f-21523a19b08c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082310 Sep 28 12:34:30.092009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 744/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:30.286938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:30.287544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:30.294434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:30.294916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:30.295343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:30.296025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:30.296510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:30.296931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:30.423236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:30.431294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dc691383-d572-4e1e-b66e-48daa61d8eed tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148274 Sep 28 12:34:30.431862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 715/1459] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:30 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:31.114244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:31.114879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:31.121272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:31.121740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:31.122185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:31.122865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:31.123303 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:31.123721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:31.138782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:31.183370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:31.191431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a41cd14c-04c0-4c4c-bd71-368ec6fe3b6c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081072 Sep 28 12:34:31.191989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 745/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:31.455568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:31.456127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:31.462565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:31.463044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:31.463481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:31.464171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:31.464656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:31.465085 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:31.593144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:31.601214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7676de7c-4daf-4e68-be8a-269ecd840bad tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149576 Sep 28 12:34:31.601782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 716/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:32.214665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:32.215219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:32.222079 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:32.222574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:32.223001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:32.223676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:32.224121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:32.224564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:32.283365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:32.291332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-163e9049-56ce-4a3e-99cd-81d83511069a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080611 Sep 28 12:34:32.291892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 746/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:32.623621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:32.624227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:32.630712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:32.631180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:32.631603 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:32.632284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:32.632748 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:32.633164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:32.757553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:32.766113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-638c0899-4ad2-410b-87cf-38b7483cebff tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146307 Sep 28 12:34:32.766673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 717/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:33.315007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:33.315651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:33.322131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:33.322609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:33.323046 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:33.323740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:33.324190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:33.324643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:33.387103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:33.395251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-675a4c4f-afad-4658-9498-6dd333511a5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084082 Sep 28 12:34:33.395822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 747/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:33.789458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:33.790111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:33.797181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:33.797657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:33.798096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:33.798786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:33.799234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:33.799656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:33.929383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:33.937602 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b08d526a-6954-4445-81cb-47dff5946ec0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152034 Sep 28 12:34:33.938163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 718/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:34.418043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:34.418586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:34.424895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:34.425368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:34.425797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:34.426478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:34.426921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:34.427338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:34.487313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:34.495777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-05d2db29-0a48-4bec-b4ae-ac5fc96cb8fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081689 Sep 28 12:34:34.496376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 748/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:34.961112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:34.961699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:34.967782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:34.968255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:34.968713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:34.969394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:34.969839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:34.970259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:35.150757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:35.159310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-106f1dec-16d2-4e3d-99f4-2f130df21c2f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.202019 Sep 28 12:34:35.159873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 719/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:34 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:35.519441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:35.520048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:35.526509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:35.526983 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:35.527435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:35.528112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:35.528583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:35.529645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:35.588288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:35.597113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7174b52f-e507-4e56-9953-4c08dd4d3921 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081545 Sep 28 12:34:35.597675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 749/1468] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:36.182742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:36.183354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:36.185678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=52 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:36.191457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:36.191936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:36.192400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:36.193093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:36.193546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:36.193973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:36.330852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:36.333158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:36.340280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fae79f30-49e8-4f68-bf95-fdc04f23b0ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.161462 Sep 28 12:34:36.340864 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 720/1469] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:36 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:36.618985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:36.620360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:36.627622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:36.628096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:36.628557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:36.629255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:36.629705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:36.630131 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:36.689534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:36.697578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a80ed99d-8534-45b6-ace1-a558a619ad96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082417 Sep 28 12:34:36.698148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 750/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:37.363330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:37.363959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:37.370364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:37.370839 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:37.371283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:37.371960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:37.372428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:37.372853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:37.497435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:37.506031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9527b3a3-28c5-4989-809f-d4b296edff03 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146594 Sep 28 12:34:37.506586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 721/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:37 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:37.721869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:37.722416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:37.729017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:37.729486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:37.729916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:37.730594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:37.731038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:37.731456 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:37.794011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:37.802103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4ffa3fea-ebc2-4956-96de-4add9c025e18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084775 Sep 28 12:34:37.802673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 751/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:38.529294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:38.529928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:38.536572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:38.537045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:38.537476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:38.538158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:38.538630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:38.539052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:38.674955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:38.683137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9e4a3323-60f6-49ac-9fd6-49ff4e6001d4 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.157704 Sep 28 12:34:38.683697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 722/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:38 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:38.824985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:38.825594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:38.832010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:38.832517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:38.832949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:38.833627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:38.834069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:38.834486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:38.893985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:38.902081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-59f1a62e-9577-4388-86ee-a5f86b7cf859 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080983 Sep 28 12:34:38.902645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 752/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:39.707343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:39.707952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:39.714351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:39.714804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:39.715235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:39.715919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:39.716401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:39.716826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:39.843922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:39.852041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7141189a-5d9d-4e06-868a-946ffd9d3653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149110 Sep 28 12:34:39.852893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 723/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:39 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:39.925584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:39.926226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:39.928539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=56 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:39.933633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:39.934106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:39.934536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:39.935283 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:39.935662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:39.936086 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:39.995724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:40.004279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5c633ef7-a16b-4edc-9e6e-cf4e35ccc2f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082985 Sep 28 12:34:40.004850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 753/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:40.876078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:40.876728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:40.883169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:40.883635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:40.884092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:40.884797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:40.885245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:40.885662 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:41.012834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:41.022185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fc0e04a0-9d4e-46fe-9897-4380dcb8349b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149534 Sep 28 12:34:41.022753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 724/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:40 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:41.026915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:41.027525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:41.033936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:41.034409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:41.034836 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:41.035511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:41.035955 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:41.036411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:41.094937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:41.103112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-517efbfe-3d0a-4a00-82c3-37e7ab794d13 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.079752 Sep 28 12:34:41.103669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 754/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:42.045127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:42.045737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:42.052849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.053332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.053766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.054461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.054918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.055347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.125847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:42.126487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:42.132881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.133474 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.133764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.134455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.134903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.135321 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.184705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:42.193053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c90f57cb-27ea-4742-b046-d7e1ab20cbaf tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151827 Sep 28 12:34:42.193630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 725/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:42 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:42.198754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:42.207554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-042e62db-b508-4899-8d9b-2b1b00afd377 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085625 Sep 28 12:34:42.208117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 755/1480] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:42.398588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:42.399008 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:42.405093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.406188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.406633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.407326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:42.407785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:42.408213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:42.430642 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8cfc0b9a-1e60-4f39-9918-5a627e80b2be tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf/ips" status: 200 len: 151 microversion: 2.1 time: 0.036094 Sep 28 12:34:42.431195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 726/1481] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:34:42 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:34:43.216138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:43.216762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:43.223753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:43.224230 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:43.224714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:43.225407 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:43.225857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:43.226279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:43.231207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:43.231926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:43.238313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:43.238783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:43.239213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:43.239897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:43.240363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:43.240787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:43.301077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:43.309252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3bf832b-6f55-4d2a-8115-cb451c5a3939 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082111 Sep 28 12:34:43.310053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 727/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:43.354616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:43.365288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8ec2b213-a831-4758-89f8-6e31c7d490e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152943 Sep 28 12:34:43.365875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 756/1483] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:43 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:44.332676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:44.333381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:44.339855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:44.340357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:44.340797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:44.341532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:44.341955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:44.342382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:44.389233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:44.390361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:44.396764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:44.397247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:44.397680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:44.398373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:44.398823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:44.399248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:44.403354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:44.412101 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-180f86db-3951-42c1-b2bc-ca5dd4867275 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083461 Sep 28 12:34:44.412701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 728/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:44.527652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:44.536766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f78ee3aa-ae06-4e08-99c4-8ab77534009f tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151378 Sep 28 12:34:44.537338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 757/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:44 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:45.434647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:45.435194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:45.442164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:45.442643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:45.443075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:45.443767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:45.444217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:45.444664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:45.507638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:45.516054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-27f010ff-1887-4458-a4cb-0478d3ca6a4f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085328 Sep 28 12:34:45.516640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 729/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:45.559517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:45.560135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:45.566713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:45.567223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:45.567662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:45.568381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:45.568848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:45.569279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:45.698740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:45.706826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4ac77654-95eb-4aeb-8589-fee916d99bfa tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151139 Sep 28 12:34:45.707395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 758/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:45 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:46.539476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:46.540086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:46.546547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:46.547023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:46.547461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:46.548150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:46.548633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:46.549062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:46.608359 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:46.617001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a87da819-351e-48d9-8356-15b8c53e81f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081520 Sep 28 12:34:46.617568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 730/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:46.730821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:46.731460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:46.738371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:46.738853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:46.739295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:46.739985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:46.740480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:46.740911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:46.866878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:46.875669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e04b4edf-8765-4315-b322-e14108833473 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148295 Sep 28 12:34:46.876272 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 759/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:46 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:47.640241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:47.641447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:47.647827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:47.648293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:47.648746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:47.649428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:47.649874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:47.650292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:47.709806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:47.717799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d54d2fcf-f6fc-42fd-a87e-9070cdcf57db tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081420 Sep 28 12:34:47.718363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 731/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:47.898647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:47.899252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:47.905646 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:47.906162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:47.906590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:47.907269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:47.907718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:47.908134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:48.038727 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:48.046784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-46f183cf-1caf-43af-8c1d-d48fbbfbe8f3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151984 Sep 28 12:34:48.047350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 760/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:47 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:48.741342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:48.741970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:48.748615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:48.749029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:48.749457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:48.750164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:48.750607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:48.751026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:48.812519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:48.820632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e4d9abb8-ed59-4eeb-b722-3ecf4a027751 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083110 Sep 28 12:34:48.821199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 732/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:49.069490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:49.070099 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:49.076576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:49.077051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:49.077479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:49.078650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:49.079094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:49.079511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:49.202085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:49.210509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-792fbf7e-667c-47c8-bfa2-efd49f04c6c8 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.144847 Sep 28 12:34:49.211067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 761/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:49 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:49.842985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:49.843599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:49.850046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:49.850519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:49.850956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:49.851640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:49.852088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:49.852781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:49.915419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:49.924083 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-699ba856-8090-41ab-aad8-29f3574bfd0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084932 Sep 28 12:34:49.924819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 733/1494] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:50.234547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:50.235184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:50.241723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:50.242199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:50.242634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:50.243319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:50.243771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:50.244191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:50.246739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:50.370640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:50.378808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c6edf224-c6b9-45b6-a6e0-fd953ee68621 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148753 Sep 28 12:34:50.379363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 762/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:50 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:50.947680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:50.948289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:50.955365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:50.955840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:50.956273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:50.957094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:50.957543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:50.957966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:51.021027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:51.029183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-09a3bfc3-dc51-4efb-a455-eee1477e89d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085332 Sep 28 12:34:51.029749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 734/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:51.403659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:51.404277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:51.410771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:51.411252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:51.411690 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:51.412408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:51.412865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:51.413290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:51.537698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:51.545912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2f0323ea-a13a-47e9-95c2-83a8248c501b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146111 Sep 28 12:34:51.546551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 763/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:51 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:52.052618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:52.053225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:52.059597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:52.060068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:52.060531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:52.061219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:52.061664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:52.062088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:52.121739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:52.129769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-430f44be-3d12-4346-a0b9-e95033aca490 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081258 Sep 28 12:34:52.130333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 735/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:52.569410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:52.570054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:52.576505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:52.576984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:52.577419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:52.578750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:52.579201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:52.579626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:52.830636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:52.838670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fbbfc3c8-8485-4157-9403-fa5dffdaf653 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.273123 Sep 28 12:34:52.839226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 764/1499] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:52 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:53.153077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:53.153633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:53.160498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:53.160968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:53.161392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:53.162095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:53.162542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:53.162960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:53.222122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:53.230381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3d23bd39-ec68-437a-83ee-9ba7112d87a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081234 Sep 28 12:34:53.230948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 736/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:53.863769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:53.864413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:53.870862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:53.871343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:53.871803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:53.872531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:53.872988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:53.873438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:54.005201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:54.013625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-312abb4d-d9e9-4a84-a268-c5bb8836a666 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.153941 Sep 28 12:34:54.014193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 765/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:53 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:54.254505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:54.255080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:54.261477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:54.261954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:54.262390 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:54.263075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:54.263526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:54.263949 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:54.325671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:54.327838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:34:54.335147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3933460-9ecd-4a9f-bdbe-36b9e8cdb42c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084522 Sep 28 12:34:54.335912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 737/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:55.044169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:55.044756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:55.051012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:55.051517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:55.051934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:55.052709 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:55.053150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:55.053602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:55.176761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:55.184785 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-927c0882-340d-4602-990a-4dec51eb2424 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.144564 Sep 28 12:34:55.185345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 766/1503] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:55 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:55.358607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:55.359144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:55.365665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:55.366139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:55.366566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:55.367247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:55.367702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:55.368118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:55.427041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:55.435034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9886e8ba-6a77-46c3-bf4d-7cb5a2de753d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080387 Sep 28 12:34:55.435592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 738/1504] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:56.207804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:56.208384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:56.214676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:56.215149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:56.215576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:56.216259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:56.216730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:56.217148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:56.346358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:56.354715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-27543e18-e36a-403d-87fb-ae70fc779fba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151076 Sep 28 12:34:56.355275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 767/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:56 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:56.458639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:56.459192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:56.465717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:56.466193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:56.466623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:56.467311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:56.467759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:56.468181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:56.528486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:56.537365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6836fc7e-5cfa-431b-95bd-ae17c8c2add2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082844 Sep 28 12:34:56.537939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 739/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:57.377685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:57.378279 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:57.384668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:57.385138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:57.385567 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:57.386276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:57.386726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:57.387141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:57.511073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:57.519151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-69746dcf-112e-4134-a113-f98845b74fc7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145967 Sep 28 12:34:57.519715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 768/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:57 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:57.560060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:57.560704 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:57.567037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:57.567506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:57.567929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:57.568646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:57.569091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:57.569509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:57.629247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:57.637198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3f834fba-fd9d-4311-97ed-b87cef12c6f3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080920 Sep 28 12:34:57.637755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 740/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:58.543004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:58.543641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:58.550557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:58.551020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:58.551446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:58.552118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:58.552611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:58.553028 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:58.660474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:58.661088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:58.667498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:58.667981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:58.668450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:58.669148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:58.669600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:58.670026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:58.682179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:58.690906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8fed41f2-3e65-43bd-bb9a-45ace72011a7 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151788 Sep 28 12:34:58.691467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 769/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:58 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:34:58.734126 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:58.742875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3dbd02f3-7208-485d-93e5-1898606eb6a6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086260 Sep 28 12:34:58.743455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 741/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:59.713658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:59.714284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:59.720855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:59.721320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:59.721744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:59.722417 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:59.722866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:59.723280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:59.766849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:34:59.767388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:34:59.773887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:59.774367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:59.774804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:59.775506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:34:59.775967 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:34:59.776416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:34:59.836671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:59.846147 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ca0d3ed9-7968-4066-8334-72b34c434f5a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083817 Sep 28 12:34:59.846731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 742/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:34:59.849923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:34:59.858458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e54e11d3-f6fe-460b-9773-687248cb2579 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148636 Sep 28 12:34:59.859155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 770/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:34:59 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:00.869233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:00.869848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:00.876438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:00.876912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:00.877585 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:00.878279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:00.878730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:00.879152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:00.881140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:00.881764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:00.888068 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:00.888581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:00.889018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:00.889706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:00.890158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:00.890578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:00.943010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:00.951322 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ca898c6-2f5f-4b4c-86ac-50557215853a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085956 Sep 28 12:35:00.951900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 743/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:01.026464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:01.036428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e4e908da-6682-4f0f-899e-b3e706f50dce tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.158713 Sep 28 12:35:01.037015 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 771/1514] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:00 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:01.975060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:01.975659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:01.982317 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:01.982792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:01.983218 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:01.983936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:01.984412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:01.987091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:02.045197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:02.053902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84956e24-094e-4481-b6a9-f689e789f6b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082735 Sep 28 12:35:02.054488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 744/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:02.061048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:02.061655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:02.068014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:02.068542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:02.068971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:02.069652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:02.070363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:02.070792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:02.198382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:02.206435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-10d17ae1-2384-4932-85bd-367ceb8f70b2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149504 Sep 28 12:35:02.206993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 772/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:02 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:03.076942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:03.077555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:03.083986 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.084506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.084942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.085635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.086084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.086508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.149500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:03.157673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b54c908d-06db-4694-9135-8eaf817cd157 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084592 Sep 28 12:35:03.158239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 745/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:03.229316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:03.229920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:03.236805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.237275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.237704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.238380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:03.238827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:03.239245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:03.363268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:03.371384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f2178352-9e0a-4778-8b16-a78fdc522bf5 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146101 Sep 28 12:35:03.371953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 773/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:03 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:04.181432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:04.182042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:04.188941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.189410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.189835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.190508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.190956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.191372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.250887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:04.258960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65bbc84d-7d3b-4888-891e-0adb167dc861 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081362 Sep 28 12:35:04.259518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 746/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:04.396073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:04.396733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:04.403247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.403723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.404158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.404879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:04.405334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:04.405758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:04.532974 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:04.541043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0b9fbb9d-f343-4a9b-95b9-eda4589a16ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.149832 Sep 28 12:35:04.541603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 774/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:04 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:05.286327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:05.286970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:05.293325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.293802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.294234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.294923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.295379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.295802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.355960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:05.364093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df7ac451-3182-4d87-8271-70e66fbc56f4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082101 Sep 28 12:35:05.364694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 747/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:05.564522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:05.565076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:05.571465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.571940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.572483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.573155 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:05.573605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:05.574029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:05.712669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:05.721180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-64aae14b-ad82-4c51-b094-f55cb720686a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.160503 Sep 28 12:35:05.721899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 775/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:05 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:06.386782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:06.387395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:06.389717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=56 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:06.395050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.395529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.395961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:06.396676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.397130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.397552 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:06.456659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:06.465491 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b7ded012-eca3-4382-9181-9bda2bb7fc12 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082549 Sep 28 12:35:06.466061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 748/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:06.745282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:06.745841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:06.751754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.752227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.752691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:06.753371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:06.753816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:06.754236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:06.879481 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:06.887809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-20c05fa8-f872-44c3-948c-0406b00ce1cb tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146571 Sep 28 12:35:06.888420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 776/1524] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:06 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:07.489166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:07.489789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:07.496415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:07.496899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:07.497333 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:07.498034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:07.498486 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:07.498911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:07.561429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:07.570245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-929b129b-4547-458b-8ae0-c9320578c3c6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084950 Sep 28 12:35:07.570811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 749/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:07.910722 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:07.911333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:07.917763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:07.918231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:07.918661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:07.919336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:07.919783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:07.920201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:08.051178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:08.059384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-50286029-8507-4332-b02a-0948a0270b0a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.152493 Sep 28 12:35:08.059954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 777/1526] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:07 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:08.593095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:08.593702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:08.600745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:08.601221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:08.601649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:08.602331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:08.603038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:08.603454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:08.907565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:08.915852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eb86183b-c9ab-40cf-9e6a-91b39b982b75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.326626 Sep 28 12:35:08.916441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 750/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:09.083997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:09.084989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:09.094461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.095245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.095913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:09.097011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.097710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.098366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:09.223845 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:09.226052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:09.233471 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b8743f6c-6d5b-48d5-ba74-f2ee0ff24f36 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154628 Sep 28 12:35:09.234038 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 778/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:09 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:09.937941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:09.938556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:09.945138 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.945617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.946052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:09.946746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:09.947198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:09.947624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.007418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:10.015566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f04e8de9-039b-491e-8125-7fe8805c961c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081584 Sep 28 12:35:10.016732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 751/1529] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:10.257325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:10.257879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:10.260399 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=52 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:10.265518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:10.266574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:10.267002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.267682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:10.268127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:10.268587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:10.396760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:10.404900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f64a8675-671f-4e03-90f6-d9643be9c91a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151515 Sep 28 12:35:10.405473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 779/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:10 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:11.040742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:11.041357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:11.049649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.052369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.052808 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.054555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.055023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.055456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.115392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:11.123751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3b4bc042-4db5-4bdc-b54d-f14e98339714 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086972 Sep 28 12:35:11.124358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 752/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:11.427485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:11.428042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:11.434562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.435043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.435478 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.436173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:11.436674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:11.437099 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:11.562778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:11.570868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b180da9d-0722-492e-a3ac-074c11cb51d3 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147521 Sep 28 12:35:11.571433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 780/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:11 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:12.147224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:12.147794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:12.154154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.154627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.155065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.155753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.156205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.156658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.215622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:12.223768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d3a3985b-495d-403e-a78f-a3f9da6dd034 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080452 Sep 28 12:35:12.224353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 753/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:12.593962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:12.595062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:12.601562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.602042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.602477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.603416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:12.603865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:12.604287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:12.736988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:12.745132 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-146e54d7-328a-4454-9b6b-70e2d1153c49 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.155022 Sep 28 12:35:12.745629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 781/1534] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:12 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:13.246536 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:13.247137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:13.254132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:13.254611 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:13.255045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:13.255740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:13.256195 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:13.256646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:13.271993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:13.319693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:13.327787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64ee6e20-0a9d-4b7d-93dc-882babd9066f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085134 Sep 28 12:35:13.328408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 754/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:13.766902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:13.767534 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:13.773972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:13.774443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:13.774871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:13.775548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:13.775993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:13.776445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:13.900519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:13.908768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6caca3e9-9ccd-486a-a864-955741e961ba tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145656 Sep 28 12:35:13.909691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 782/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:13 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:14.351726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:14.352285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:14.359421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:14.359899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:14.360343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:14.361234 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:14.361679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:14.362094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:14.424579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:14.432594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8b067d9-f948-4e62-bac3-d1720216c4f0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085008 Sep 28 12:35:14.433158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 755/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:14.936762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:14.937369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:14.947561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:14.947561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:14.947561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:14.947561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:14.948000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:14.948000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:15.085938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:15.094168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b753071a-1483-4dc5-a528-836e2a76c744 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.161307 Sep 28 12:35:15.094812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 783/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:14 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:15.454896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:15.455596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:15.462046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:15.462523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:15.462956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:15.463655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:15.464106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:15.464560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:15.526127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:15.535174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5040157c-dadb-4f8b-9257-f7457b848dd8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084095 Sep 28 12:35:15.535734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 756/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:16.118569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:16.119161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:16.125642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:16.126231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:16.126666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:16.127932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:16.128403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:16.128825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:16.274218 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:16.282370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-77b6f9b8-ffb1-4650-ab21-547663dd5a43 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.167641 Sep 28 12:35:16.282939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 784/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:16 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:16.557688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:16.558297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:16.565574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:16.566050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:16.566483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:16.567170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:16.567622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:16.568045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:16.630420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:16.638931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d24ad127-d228-4b77-8fc3-2c476425e450 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085129 Sep 28 12:35:16.639863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 757/1541] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:17.305885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:17.306531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:17.313558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:17.314032 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:17.314461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:17.315140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:17.315591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:17.316011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:17.442499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:17.452010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b400e411-0fda-4b52-8fc8-d05f5e05d5d2 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.150022 Sep 28 12:35:17.453350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 785/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:17 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:17.661732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:17.662275 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:17.668730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:17.669211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:17.669648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:17.670344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:17.670795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:17.671221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:17.734118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:17.742842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0494f4ce-d207-4908-903f-fe12fc4f7d5c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085040 Sep 28 12:35:17.743418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 758/1543] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:18.475703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:18.476301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:18.483187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:18.483687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:18.484123 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:18.485438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:18.485890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:18.486316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:18.612288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:18.620427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8627d801-74a4-43ec-b8a0-850bd8f47135 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148647 Sep 28 12:35:18.621009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 786/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:18 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:18.765010 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:18.765583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:18.771923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:18.772434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:18.772867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:18.773549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:18.774004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:18.774425 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:18.834310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:18.842487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-833b4474-9eed-4de4-a6e8-0d402d1f496c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081331 Sep 28 12:35:18.843055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 759/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:19.643462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:19.644076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:19.650591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:19.651069 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:19.651506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:19.652192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:19.652677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:19.653106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:19.779589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:19.787745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-41dfabc2-4f9d-4ccc-9094-85fe9d8ff9ac tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148158 Sep 28 12:35:19.788359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 787/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:19 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:19.866507 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:19.867125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:19.873595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:19.874070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:19.874506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:19.875880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:19.876367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:19.876798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:19.935976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:19.945078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-90e5596c-63df-43c6-8ab3-482b74830cdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082471 Sep 28 12:35:19.945645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 760/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:20.811266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:20.811880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:20.818879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:20.819356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:20.819786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:20.820503 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:20.820956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:20.821381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:20.945524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:20.954278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f660e6f7-4260-4aff-807d-801bfdc6da6a tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146929 Sep 28 12:35:20.954842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 788/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:20 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:20.966832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:20.967457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:20.973978 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:20.974455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:20.974886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:20.975572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:20.976025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:20.976483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:21.036637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:21.044742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-711d0a21-2bf1-4e49-a330-ed25d06caa39 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081680 Sep 28 12:35:21.045329 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 761/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:21.978134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:21.978911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:21.988022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:21.988830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:21.989473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:21.990206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:21.990662 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:21.991090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:22.067868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:22.068674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:22.075703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:22.076255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:22.076726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:22.077429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:22.077874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:22.078293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:22.144712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:22.153407 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-037dda6a-9e83-4ca2-8860-fe921cd73c18 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089423 Sep 28 12:35:22.154000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 762/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:22.344184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:22.355373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d14f736d-9e5a-4a38-b8ba-56eaf6b5d845 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.381178 Sep 28 12:35:22.356240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 789/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:21 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:23.177286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:23.177924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:23.184495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:23.184975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:23.185431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:23.186113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:23.186586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:23.187004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:23.246042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:23.254102 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ef1ea34-dbd7-4a9d-88a9-b6ba8c85f686 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080718 Sep 28 12:35:23.254661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 763/1552] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:23.389007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:23.389611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:23.396510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:23.396984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:23.397415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:23.398092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:23.398542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:23.398956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:23.524351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:23.533150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00d49834-87fc-49d3-846b-f7fd3382d6db tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.147964 Sep 28 12:35:23.533710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 790/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:23 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:24.276607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:24.277143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:24.283541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.284009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.284458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.285136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.285581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.285997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.346380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:24.354909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ee31665e-95b7-4176-9ff6-af086db4b514 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082300 Sep 28 12:35:24.355586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 764/1554] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:24.555769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:24.556406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:24.562810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.563281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.563710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.564412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:24.564860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:24.565277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:24.690810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:24.698850 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-21ffbe7d-ce49-46da-9f1b-32a0bb89b549 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146903 Sep 28 12:35:24.699413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 791/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:24 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:25.378762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:25.379447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:25.385713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.386184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.386609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.387293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.387741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.388159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.447336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:25.456074 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39824ce1-c995-4b71-a012-3350953781bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081648 Sep 28 12:35:25.456666 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 765/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:25.721864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:25.722477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:25.729224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.729701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.730137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.730824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:25.731276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:25.731699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:25.857313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:25.866015 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-18741669-1ffb-476b-9a8f-34ac3bdf524e tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.148039 Sep 28 12:35:25.866579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 792/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:25 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:26.479738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:26.480357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:26.487447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.487924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.488376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:26.489084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.489534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.489958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:26.551835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:26.559911 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-480931ab-5484-45fa-9dc6-2516a78ec75f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084305 Sep 28 12:35:26.560501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 766/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:26.889623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:26.890228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:26.896586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.897060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.897497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:26.898176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:26.898622 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:26.899037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:27.028825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:27.037547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-defc1a8d-d077-41ea-89f9-27a1b944182b tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151803 Sep 28 12:35:27.038124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 793/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:26 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:27.583285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:27.583887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:27.590332 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:27.590801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:27.591225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:27.591902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:27.592371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:27.592791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:27.652945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:27.660969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5c0222e4-58db-4706-807b-a87b0242d96f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081532 Sep 28 12:35:27.661544 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 767/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:28.061538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:28.062154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:28.068599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.069078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.069541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.070234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.070684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.071109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.195088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:28.203775 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3cd86119-7a07-496f-9e95-21b83aa89c8d tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145676 Sep 28 12:35:28.204355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 794/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:28 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:28.683064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:28.683693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:28.690667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.691134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.691560 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.692239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:28.692718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:28.693136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:28.752421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:28.760644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b6fc9b1b-206d-4720-8b12-fae9c3f8f411 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081423 Sep 28 12:35:28.761202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 768/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:29.226582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:29.227186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:29.233864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.234993 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:29.235422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:29.236094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.236575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:29.236992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:29.251353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=100 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:29.361220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:29.369312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2db9fd65-6d80-4281-b722-25018a630442 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.146622 Sep 28 12:35:29.369870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 795/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:29 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:29.783418 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:29.784034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:29.790589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.791069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:29.791505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:29.792197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:29.792680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:29.793108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:29.853392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:29.861754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-479a88df-3d8e-4e08-b1c7-bcaf5759c2e4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082269 Sep 28 12:35:29.862319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 769/1564] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:30.392126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:30.392757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:30.399398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:30.399880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:30.400332 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:30.401059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:30.401509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:30.401968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:30.530740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:30.539418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bcd7c3f0-fa6a-4a0a-80ac-c998955967ca tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.151175 Sep 28 12:35:30.539980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 796/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:30 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:30.884722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:30.885328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:30.892302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:30.892798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:30.893226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:30.893910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:30.894354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:30.894778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:30.956944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:30.965062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cbc0836-73d0-4052-8c1f-ed7118ab369c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084254 Sep 28 12:35:30.965616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 770/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:31.563600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:31.564221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:31.571603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.572085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.572553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:31.573248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.573702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.574403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:31.713288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:31.721557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e7a6d74e-6d6c-4088-871e-4fdcba1d79e0 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.162501 Sep 28 12:35:31.722134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 797/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:31 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:31.989265 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:31.989863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:31.996221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.996726 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.997153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:31.997834 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:31.998311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:31.998730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:32.001474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:32.059506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:32.067759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6c96190-6f28-49bb-9c20-52e5dc6d7bb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082332 Sep 28 12:35:32.068336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 771/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:32.745335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:32.745894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:32.752782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:32.753252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:32.753680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:32.754365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:32.754813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:32.755227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:32.886920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:32.895973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fbe07a41-09e0-4b7b-8bb9-5256756c7145 tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.154593 Sep 28 12:35:32.896566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 798/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:32 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:33.089722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:33.090331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:33.096762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.097242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.097678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:33.098368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.098816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.099241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:33.163363 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:33.172025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dac2649c-0a51-49b2-9342-d029f5b2122d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085706 Sep 28 12:35:33.172639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 772/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:33.919468 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:33.920130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] [instance: f70275a6-f5ea-4b01-b384-32c64c06551d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:33.926572 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.927047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.927489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:33.928166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:33.928642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:33.929063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:34.053226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e428194fecb425fb4e1264ce6c49051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedaf31a9b64cbfb658837f17204f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:34.061416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-449237f9-7492-4ed8-9842-c1da228b9f3c tempest-VolumesSnapshotTestJSON-255536077 tempest-VolumesSnapshotTestJSON-255536077-project] 10.222.0.26 "GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d" status: 200 len: 1561 microversion: 2.1 time: 0.145818 Sep 28 12:35:34.062157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 799/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:33 2022] GET /compute/v2.1/servers/f70275a6-f5ea-4b01-b384-32c64c06551d => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:34.195652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:34.196876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:34.203871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:34.204342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:34.204945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:34.205630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:34.206073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:34.206493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:34.266652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:34.274898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff8624a0-4c73-42c0-8ffc-7071f05ccc48 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083085 Sep 28 12:35:34.275685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 773/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:35.298480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:35.299160 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:35.305483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:35.305960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:35.306389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:35.307070 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:35.307517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:35.307938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:35.368071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:35.376946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b34c218f-2c4c-49ea-9c08-c6e87f1c435b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082834 Sep 28 12:35:35.377508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 800/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:36.399135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:36.399799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:36.401847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=52 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:36.407190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:36.407664 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:36.408093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:36.408810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:36.409263 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:36.409689 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:36.472541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:36.480853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b67ca139-9307-49ce-b07b-5015ccb29371 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085580 Sep 28 12:35:36.481417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 774/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:37.505291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:37.505907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:37.511933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:37.512451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:37.512890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:37.513583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:37.514039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:37.514464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:37.577591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:37.585791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-da98a028-60dc-4f41-a9a1-7bc294cc25cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084602 Sep 28 12:35:37.586355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 801/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:38.608831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:38.609466 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:38.616084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:38.616591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:38.617020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:38.617701 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:38.618151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:38.618568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:38.680045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:38.688739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a4fd3aeb-bdbd-44b9-b723-4062a71f7ce2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083709 Sep 28 12:35:38.689304 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 775/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:39.711862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:39.712506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:39.719450 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:39.719920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:39.720375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:39.721059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:39.721505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:39.721928 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:39.781962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:39.790147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e5d5cd7d-5e21-4dc8-8ce3-ed8b47ca23d6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082149 Sep 28 12:35:39.790706 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 802/1577] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:40.813959 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:40.814566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:40.821016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.821489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.821920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.822599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:40.823045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:40.823461 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:40.882944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:40.891199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3218364a-d8f9-4efc-8022-21febf261923 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081670 Sep 28 12:35:40.891756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 776/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:41.913921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:41.914533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:41.916997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=48 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:41.922476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:41.922952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:41.923385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:41.924075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:41.924559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:41.924987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:41.985142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:41.993445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e8544ded-4e6e-4548-b8b2-e1349e8a8f92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083434 Sep 28 12:35:41.993998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 803/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:43.017055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:43.017643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:43.024091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:43.024595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:43.025030 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:43.025710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:43.026157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:43.026576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:43.087294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:43.096031 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f716bb55-2dc5-46f6-bf72-cb5145cc19cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083347 Sep 28 12:35:43.096637 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 777/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:44.118304 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:44.119072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:44.125639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:44.126114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:44.126547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:44.127255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:44.127702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:44.128126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:44.188788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:44.196918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-88f5641e-cb9c-4dc4-b9f6-9c89db5bf400 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082608 Sep 28 12:35:44.197483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 804/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:45.219981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:45.220576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:45.226951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:45.227429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:45.227879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:45.228843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:45.229294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:45.229720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:45.291925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:45.300626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-53aeb14f-3619-40be-8867-3c8b3c2cd370 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084661 Sep 28 12:35:45.301189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 778/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:46.324229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:46.324891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:46.331938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:46.332443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:46.332871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:46.333552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:46.333996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:46.334414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:46.394773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:46.402924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6954b61c-a4d7-4a95-8f47-c1829e0ed5ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082512 Sep 28 12:35:46.403496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 805/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:47.425604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:47.426202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:47.432615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:47.433084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:47.433510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:47.434189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:47.434635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:47.435049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:47.495589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:47.503771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9ee08ae0-5b91-43c0-a87c-e049cd94bf70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081987 Sep 28 12:35:47.504362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 779/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:48.527292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:48.527897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:48.534854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:48.535327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:48.535751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:48.536457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:48.536905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:48.537323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:48.600328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:48.609319 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bc1009ea-60f9-40e4-bf8f-b812cd8d96cb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085263 Sep 28 12:35:48.609880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 806/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:49.632011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:49.632644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:49.639038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:49.639508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:49.639938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:49.640655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:49.641100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:49.641520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:49.700830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:49.708879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14545e5c-38e0-42e7-98c6-cbf100388993 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080694 Sep 28 12:35:49.709435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 780/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:50.731769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:50.732515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:50.739796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:50.740269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:50.740730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:50.741469 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:50.741967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:50.742386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:50.805056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:50.813697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-963a6e6f-323c-4468-add3-91db38d12bdf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086123 Sep 28 12:35:50.814259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 807/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:51.837015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:51.837623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:51.844237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:51.844744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:51.845172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:51.845850 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:51.846296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:51.846713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:51.906690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:51.914779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42ee0cc4-13af-457b-938a-0596ac6bb4ab tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081701 Sep 28 12:35:51.915343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 781/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:52.938590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:52.939206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:52.945754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:52.946226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:52.946654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:52.947335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:52.947777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:52.948192 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:53.010609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:53.019341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0de006ff-c194-49c0-b5fd-776331b939c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085318 Sep 28 12:35:53.019914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 808/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:54.042173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:54.042787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:54.049891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:54.050372 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:54.050806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:54.051501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:54.051955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:54.052405 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:54.114926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:54.123053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d68bdd0b-9577-4306-a561-d57cb9474ff0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084785 Sep 28 12:35:54.123624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 782/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:55.146264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:55.146870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:55.153355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:55.153843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:55.154280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:55.154972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:55.156101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:55.156562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:55.215840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:55.224170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-42f6fcac-c18d-4b9f-a0a6-736b489c87b6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081818 Sep 28 12:35:55.224774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 809/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:56.247475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:56.248026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:56.254409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:56.254886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:56.255324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:56.256011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:56.256497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:56.256924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:56.316627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:56.324772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-991270f7-1248-4c75-8233-1bdae57a9446 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081093 Sep 28 12:35:56.325334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 783/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:57.347820 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:57.348463 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:57.355143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:57.355619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:57.356056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:57.356778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:57.357226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:57.357651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:57.420012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:57.428711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-46901f06-2984-4bfe-859b-063c4ce332a4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084754 Sep 28 12:35:57.429281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 810/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:35:58.451925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:58.453215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:58.459641 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:58.460114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:58.460586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:58.461268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:58.461718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:58.462139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:58.522082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:58.530165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d6a2174a-14f1-433d-9df5-cc571386d7b4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082066 Sep 28 12:35:58.530724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 784/1594] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:35:59.553031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:35:59.553639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:35:59.560018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:59.560513 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:59.560940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:59.561616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:35:59.562058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:35:59.562500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:35:59.565024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=94 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:35:59.623885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:35:59.631966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-64797da3-4b3d-4d99-9ecb-49e2985a143c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082792 Sep 28 12:35:59.632569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 811/1595] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:35:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:00.655811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:00.656577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:00.666842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:00.667331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:00.667774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:00.668499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:00.668958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:00.669389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:00.729480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:00.738318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-86ff0699-420e-4335-a081-0148f0b8579c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086851 Sep 28 12:36:00.738888 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 785/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:01.761064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:01.761621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:01.768094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:01.768613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:01.769050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:01.769734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:01.770186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:01.770611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:01.829714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:01.838751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4c89a0a3-df5d-43cc-9ea7-8b74cfb4cb96 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081652 Sep 28 12:36:01.839330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 812/1597] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:02.861699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:02.862306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:02.869224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:02.869694 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:02.870122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:02.870803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:02.871248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:02.871668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:02.876056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=90 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:02.936068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:02.945155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6ff0a470-2bab-4f88-b91d-9a2236bfbd91 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087248 Sep 28 12:36:02.945720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 786/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:03.969458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:03.970114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:03.976922 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:03.979011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:03.979011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:03.979277 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:03.979617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:03.980042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:04.043031 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:04.051314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-219f3d75-a73a-4292-a5f0-ecc863501a89 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086369 Sep 28 12:36:04.051915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 813/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:05.073527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:05.074136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:05.080179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:05.080697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:05.081135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:05.081820 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:05.082274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:05.082698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:05.142616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:05.150630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5f3b5cc-e16b-48d0-9c04-429987ffcb14 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080915 Sep 28 12:36:05.151202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 787/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:06.174666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:06.175280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:06.181144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:06.181615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:06.182047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:06.182717 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:06.183163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:06.183577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:06.245889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:06.254581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-80c197ee-4f44-448b-8e45-44776794ccdd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084486 Sep 28 12:36:06.255142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 814/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:07.276389 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:07.277001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:07.279280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:07.284448 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:07.284928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:07.285357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:07.286045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:07.286525 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:07.286951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:07.349943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:07.358343 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-32109269-20b7-4e2d-a50c-2934f4f6bace tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085900 Sep 28 12:36:07.358906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 788/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:08.380524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:08.381142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:08.387509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:08.387988 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:08.388449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:08.389129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:08.390064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:08.390482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:08.449729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:08.458353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-091abff4-c322-464c-8c9c-0b1cdfacd648 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081759 Sep 28 12:36:08.458918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 815/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:09.482149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:09.482747 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:09.489561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:09.490044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:09.490479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:09.491178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:09.491628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:09.492053 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:09.552202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:09.560238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8304aaaf-3118-4fe6-9862-53b94b2a35f1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082279 Sep 28 12:36:09.560840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 789/1604] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:10.583413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:10.584007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:10.590433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:10.590912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:10.591343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:10.592029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:10.592514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:10.592939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:10.652946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:10.661133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c8a3f474-a467-4ae9-b302-a55d9f93beb1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081625 Sep 28 12:36:10.661698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 816/1605] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:11.685643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:11.686892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:11.693400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:11.693876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:11.694307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:11.694993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:11.695444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:11.695867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:11.756722 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:11.765444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c5e04e7c-fdeb-4b71-81ac-5d349cb2371b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083554 Sep 28 12:36:11.766012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 790/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:12.787927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:12.788579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:12.790907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:12.796770 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:12.797249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:12.797687 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:12.798378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:12.798831 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:12.799255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:12.861295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:12.869351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b34c01c-0125-44ad-b53b-54636024df92 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085323 Sep 28 12:36:12.869914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 817/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:13.892094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:13.892740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:13.895291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:13.895430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:36:13.896440 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:13.896595 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:36:13.897489 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:13.897643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:36:13.908158 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:13.908670 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:13.909109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:13.909817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:13.910272 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:13.910703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:13.977728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:13.988075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-61d7cf2e-70f7-4a82-8822-8d419b86178c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.099929 Sep 28 12:36:13.988681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 791/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:15.009990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:15.010579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:15.018117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:15.018591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:15.019019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:15.019726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:15.020171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:15.020614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:15.082712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:15.090719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0c1322e8-a54f-448d-9964-9cd6c83a2d3e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084542 Sep 28 12:36:15.091282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 818/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:16.113648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:16.114249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:16.120643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:16.121119 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:16.121545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:16.122228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:16.122673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:16.123091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:16.186062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:16.194019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d27fc2cb-6381-4705-ac6c-f74fab87f92a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084261 Sep 28 12:36:16.194578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 792/1610] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:17.216832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:17.217946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:17.220269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:17.220422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:36:17.221720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:36:17.221889 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:36:17.229387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:17.229864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:17.230329 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:17.230991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:17.231446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:17.231878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:17.297375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:17.305627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4ee824b4-4fc7-44f6-b2c8-d3e85f52024b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.092893 Sep 28 12:36:17.306207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 819/1611] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:36:18.327687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:18.328347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:18.334779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:18.335255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:18.335690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:18.336402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:18.336855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:18.337279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:18.396460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:18.405170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1c152530-4ea5-4922-8fbd-236a10e16efc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080640 Sep 28 12:36:18.405740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 793/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:19.427806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:19.428473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:19.434898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:19.435373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:19.436301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:19.437012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:19.437462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:19.437884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:19.497545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:19.506234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8df3315a-c03a-450d-800e-3c275ab3c323 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082367 Sep 28 12:36:19.506795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 820/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:20.530656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:20.531360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:20.537868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:20.538342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:20.538796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:20.539614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:20.540061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:20.540513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:20.601090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:20.609636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20170b0f-1e20-4230-be58-b3798958d046 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083550 Sep 28 12:36:20.610202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 794/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:21.632765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:21.633396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:21.639720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:21.640194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:21.640659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:21.641346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:21.641792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:21.642212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:21.702348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:21.710546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2a31e0e0-4a40-4421-8aa4-b9eb7ace0165 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081620 Sep 28 12:36:21.711115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 821/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:22.733223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:22.733828 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:22.740187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:22.740691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:22.741120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:22.741799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:22.742245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:22.742663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:22.802112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:22.810257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-39c3296c-3b4b-46db-9dbf-38172e5dfcd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080994 Sep 28 12:36:22.810855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 795/1616] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:23.833363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:23.833967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:23.840385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:23.840864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:23.841288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:23.842447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:23.842917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:23.843334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:23.906611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:23.914601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9248391b-d35d-40a8-8e72-6d3d12f92b6e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085117 Sep 28 12:36:23.915166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 822/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:36:24.938061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:24.938676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:24.945262 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:24.945751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:24.946179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:24.946872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:24.947328 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:24.947754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:25.010761 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:25.019155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0f17c4c2-d8a6-4bf9-be8b-b351ecfe1a11 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085695 Sep 28 12:36:25.019717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 796/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:26.105368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:26.105976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:26.112491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:26.113036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:26.113557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:26.114236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:26.114680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:26.115103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:26.174395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:26.182565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d92cae9c-033f-49a6-b842-b4d74054621c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.144253 Sep 28 12:36:26.183138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 823/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:27.205072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:27.205683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:27.212068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:27.212576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:27.213029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:27.213696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:27.214148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:27.214578 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:27.274412 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:27.282617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8a85a424-8125-4533-a7ad-b806c1c46f93 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081361 Sep 28 12:36:27.283173 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 797/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:28.306026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:28.306675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:28.313163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:28.313643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:28.314077 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:28.314761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:28.315210 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:28.315633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:28.377460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:28.385489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-34fa8e57-2377-476d-938f-a4975c63ff5f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083368 Sep 28 12:36:28.386056 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 824/1621] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:29.407638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:29.408264 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:29.414682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:29.415157 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:29.415586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:29.416278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:29.416750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:29.417182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:29.476514 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:29.485408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2aa7e46f-09ae-4be4-b98c-05b8cb085a80 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081635 Sep 28 12:36:29.485982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 798/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:30.508497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:30.509109 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:30.516134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:30.516626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:30.517053 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:30.517735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:30.518177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:30.518596 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:30.522442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=84 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:30.578602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:30.586761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-389e76f5-9f08-449f-90f3-a31012089baa tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082125 Sep 28 12:36:30.587335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 825/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:31.610378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:31.611600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:31.618060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:31.618540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:31.618977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:31.619661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:31.620113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:31.620584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:31.679785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:31.687804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-69b996f7-6f80-48f5-8b1e-eadf34339a19 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081289 Sep 28 12:36:31.688394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 799/1624] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:32.713199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:32.713740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:32.720120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:32.720627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:32.721063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:32.721749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:32.722207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:32.722631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:32.785167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:32.793314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d175710e-7fbe-4c2b-89e9-d2088b906bb6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084109 Sep 28 12:36:32.793881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 826/1625] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:33.815971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:33.816626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:33.823047 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:33.823529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:33.823964 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:33.824677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:33.825127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:33.825549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:33.829439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:33.890065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:33.898826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64f1eedb-12f7-49b5-9c0b-bf28caa170ae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086690 Sep 28 12:36:33.899394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 800/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:34.921769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:34.922383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:34.929404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:34.929880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:34.930313 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:34.930996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:34.931465 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:34.931865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:34.993300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:35.001435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-51933146-f4b6-4f9a-856a-a9dd1b20bf21 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083560 Sep 28 12:36:35.002023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 827/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:36.023983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:36.024646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:36.030947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:36.031350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:36.031771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:36.032496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:36.032941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:36.033361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:36.093675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:36.102257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3af035dd-3e7d-4a2a-8caa-20a025a79768 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082096 Sep 28 12:36:36.102826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 801/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:37.126780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:37.127924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:37.133986 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:37.134475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:37.134912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:37.135600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:37.136051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:37.136505 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:37.196457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:37.204557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bc6440f1-f51b-4abf-b380-5ed1f9b3032f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081794 Sep 28 12:36:37.205127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 828/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:38.226435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:38.226988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:38.229570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:38.234979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:38.235460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:38.235896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:38.237113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:38.237568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:38.237990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:38.299597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:38.307696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-703d523b-5fc1-4122-800a-8582c017249e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085165 Sep 28 12:36:38.308260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 802/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:39.331020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:39.331635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:39.338084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:39.338556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:39.338989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:39.339700 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:39.340171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:39.340621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:39.402029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:39.410773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2d4ba4a5-7f41-4c32-ae17-7ed40fe1572c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083620 Sep 28 12:36:39.411338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 829/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:40.434077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:40.434711 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:40.441454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:40.442152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:40.442620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:40.443375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:40.443829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:40.444247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:40.504346 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:40.512397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36dda08c-67b6-4c21-8cda-f1198fd2137a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082113 Sep 28 12:36:40.512954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 803/1632] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:41.535584 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:41.536198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:41.542697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:41.543205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:41.543639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:41.544344 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:41.544800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:41.545229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:41.608782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:41.617833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-803c8bac-7ed1-44fa-a549-f22d04f26530 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086163 Sep 28 12:36:41.618404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 830/1633] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:42.640718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:42.641326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:42.648442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:42.648916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:42.649342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:42.650052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:42.650498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:42.650947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:42.712875 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:42.720957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6074e098-c96b-4fab-b02e-03301a0a6e35 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084056 Sep 28 12:36:42.721519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 804/1634] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:43.744866 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:43.745413 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:43.747672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:36:43.753542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:43.754012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:43.754442 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:43.755119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:43.755562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:43.755978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:43.815350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:43.823421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7f0f3e6d-1051-4cd3-9c56-dfdcd7abf4d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082461 Sep 28 12:36:43.824006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 831/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:44.846475 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:44.847102 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:44.853897 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:44.854433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:44.854877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:44.855586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:44.856075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:44.856534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:44.916687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:44.924779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-92dd8dfc-33a9-414d-91d2-8f0015816d0b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082287 Sep 28 12:36:44.925365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 805/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:45.948244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:45.948898 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:45.955248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:45.955723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:45.956150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:45.957432 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:45.957876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:45.958291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:46.017594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:46.026342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-db18f08c-414f-4b1c-ae8b-44ae2c165c1e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081999 Sep 28 12:36:46.026900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 832/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:47.048947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:47.049559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:47.056185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:47.056696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:47.057132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:47.057823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:47.058308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:47.058733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:47.118564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:47.126574 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-36ac9b9e-68fd-4b16-8ede-385300079ae4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081464 Sep 28 12:36:47.127134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 806/1638] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:48.149704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:48.150248 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:48.156950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:48.157457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:48.157894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:48.158586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:48.159040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:48.159464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:48.218977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:48.227246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b74e8878-9b39-47f3-b4ba-974e5a9191a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081496 Sep 28 12:36:48.227809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 833/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:49.254019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:49.254621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:49.261020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:49.261500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:49.261933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:49.262624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:49.263076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:49.263501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:49.323454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:49.331610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-70c3a08d-e7ee-4fb8-abf7-fb73cf9bc9b5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082076 Sep 28 12:36:49.332153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 807/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:50.354323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:50.354959 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:50.361351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:50.361821 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:50.362251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:50.362926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:50.363368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:50.363782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:50.427083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:50.435224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3d3f0efd-aec3-49c0-8626-5b8afa215b2f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085037 Sep 28 12:36:50.435780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 834/1641] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:51.458914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:51.459540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:51.465915 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:51.466387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:51.466814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:51.467494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:51.467944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:51.468385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:51.531479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:51.540202 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84e2a19f-54ce-404c-9e8c-2753e3309ae0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085604 Sep 28 12:36:51.540790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 808/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:52.561897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:52.562508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:52.568906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:52.569381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:52.569813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:52.570498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:52.570949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:52.571373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:52.631082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:52.639191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-679ab2d2-f818-4d22-b3f5-5e4a226fc8e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081247 Sep 28 12:36:52.639758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 835/1643] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:53.662401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:53.663006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:53.669403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:53.669878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:53.670306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:53.670987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:53.671431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:53.671847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:53.732357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:53.740640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5ef67da6-c96b-4946-94bc-8cff14e01229 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082617 Sep 28 12:36:53.741242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 809/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:54.763652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:54.764198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:54.770561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:54.771030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:54.771457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:54.772127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:54.772611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:54.773027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:54.832113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:54.840239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-063aa4ab-102a-4a71-92c8-3d20a18d439d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080518 Sep 28 12:36:54.840829 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 836/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:55.864301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:55.864936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:55.871779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:55.872259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:55.872733 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:55.873426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:55.873918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:55.874347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:55.934229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:55.942898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf4a6336-c2f6-4fb8-95be-360159aba835 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083078 Sep 28 12:36:55.943449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 810/1646] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:56.965493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:56.966133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:56.972778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.973255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.973688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:56.974373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:56.974822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:56.975245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:57.035369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:57.043473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9d2f738b-f1e1-42ae-9847-8e15f46eee41 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081876 Sep 28 12:36:57.044037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 837/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:58.065927 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:58.066515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:58.073296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:58.073767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:58.074190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:58.074871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:58.075316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:58.075734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:58.139500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:58.148077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4eabc4df-700c-4048-a5e5-c606a9f7c426 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086015 Sep 28 12:36:58.148668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 811/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:36:59.171274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:36:59.171882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:36:59.178358 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.178832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.179264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.179948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:36:59.180418 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:36:59.180842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:36:59.245146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:36:59.253166 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7a781b86-294a-41e1-99d4-64993d35507e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085724 Sep 28 12:36:59.253728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 838/1649] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:36:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:00.277023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:00.277567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:00.283996 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:00.284505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:00.284941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:00.285628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:00.286080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:00.286504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:00.349341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:00.357714 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2d6d38b2-b0f8-4caa-848d-6455dc3e3bc9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084612 Sep 28 12:37:00.358312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 812/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:01.380127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:01.380758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:01.387143 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.387610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.388041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.388746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:01.389193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:01.389611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:01.392103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=84 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:01.449931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:01.458586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd0ac4b4-93b1-49a1-b965-34b345c46bd4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082329 Sep 28 12:37:01.459147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 839/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:02.481409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:02.481998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:02.488581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.489069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.489500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.490205 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:02.490655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:02.491075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:02.551903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:02.560018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bbfa65f9-e439-4378-9f4d-095ef492883f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082704 Sep 28 12:37:02.560622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 813/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:03.583273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:03.583912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:03.590633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.591114 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.591545 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.592236 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:03.592712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:03.593177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:03.654129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:03.662904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f60415e4-f09e-443a-8d11-dfec6fab20fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083530 Sep 28 12:37:03.663476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 840/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:04.685636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:04.686253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:04.692284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.692794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.693231 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.693925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:04.694378 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:04.694804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:04.697411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:04.776354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:04.784575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-eabb45c5-d7c7-4899-bc8f-5266e17c481e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.102857 Sep 28 12:37:04.785159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 814/1654] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:05.807914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:05.808547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:05.814853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.815323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.815751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.816451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:05.816900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:05.817317 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:05.878436 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:05.887558 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0d9cf3c0-8054-41e4-9ec6-daf1c6cf7a24 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083414 Sep 28 12:37:05.888120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 841/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:06.910746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:06.911521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:06.917957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.918432 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.918868 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.919561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:06.920016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:06.920473 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:06.980631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:06.988583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-82b18da6-28a0-4336-8fe8-6d57b0e0828c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081775 Sep 28 12:37:06.989151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 815/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:08.011453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:08.012067 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:08.018125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:08.018607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:08.019040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:08.020221 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:08.020851 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:08.021281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:08.084128 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:08.092362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b415528c-e925-4bcf-9291-3becdda4aecb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084892 Sep 28 12:37:08.092929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 842/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:09.115134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:09.115744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:09.118134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:09.123540 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.124016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.124472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.125159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:09.125606 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:09.126023 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:09.190348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:09.198874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5807cbaf-9b3e-458f-9ef9-4cd8d31568fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087569 Sep 28 12:37:09.199437 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 816/1658] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:10.222275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:10.223383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:10.230091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.230540 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.230962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.231638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:10.232080 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:10.232529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:10.292149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:10.300573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6afbebd2-f34b-4d6d-a77d-234d732f5086 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082229 Sep 28 12:37:10.301140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 843/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:11.323198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:11.323790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:11.330217 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.330695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.331130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.331824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:11.332277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:11.332732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:11.391756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:11.399738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2ee91385-30cb-40ed-8430-dc4a3a11f711 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080434 Sep 28 12:37:11.400323 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 817/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:12.422949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:12.423603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:12.430049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.430529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.430965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.431659 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:12.432120 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:12.432577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:12.493713 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:12.501950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-818d30e9-208f-4937-8acf-9cc78336be00 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082917 Sep 28 12:37:12.502522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 844/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:13.524974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:13.525573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:13.531932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.532441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.532876 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.533551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:13.533997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:13.534421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:13.593754 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:13.602342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-611ddda8-62a3-4dff-af68-3206c82905d9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081215 Sep 28 12:37:13.602902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 818/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:14.626024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:14.626629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:14.629630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:14.634957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.635430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.635867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:14.636593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:14.637043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:14.637467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:14.696849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:14.704914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-30a54d42-08ac-4f16-b107-5c2e1178192e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082759 Sep 28 12:37:14.705479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 845/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:15.728887 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:15.729479 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:15.735799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:15.736269 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:15.736723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:15.737403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:15.737848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:15.738873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:15.797825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:15.806653 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-471e0316-5e2b-43da-a661-f9c1808e9678 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081909 Sep 28 12:37:15.807215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 819/1664] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:16.284042 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:16.285816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:16.292871 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.293551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.294367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.295245 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.295975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.296601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.322621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:37:16.425916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7b3c7bb0-e1e5-4947-93fa-9031a815f2c1 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "DELETE /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 204 len: 0 microversion: 2.1 time: 0.145292 Sep 28 12:37:16.426783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 846/1665] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:37:16 2022] DELETE /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 12:37:16.435000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:16.435610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:16.442282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.443068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.443581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.444426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.444956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.445384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.595438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:16.603261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a562e493-3289-4168-a88a-275a28d7639a tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1507 microversion: 2.1 time: 0.172321 Sep 28 12:37:16.604086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 820/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:16 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:16.829945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:16.830658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:16.837191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.837674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.838113 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.838809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:16.839263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:16.839688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:16.904208 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:16.913096 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-88687a69-fecb-4314-aa5d-4c34f7598a0c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087392 Sep 28 12:37:16.913660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 847/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:17.633559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:17.636545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:17.647159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.648252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.649073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.649969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.650584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.651316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.682541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731779ea-c029-470d-af83-4091842d12f7", "name": "network-vif-deleted", "tag": "e5002f8f-acaa-44e8-88ec-5dce7805e265"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:17.694653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.695127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.695783 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.720388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] Creating event network-vif-deleted:e5002f8f-acaa-44e8-88ec-5dce7805e265 for instance 731779ea-c029-470d-af83-4091842d12f7 on hv-cinder-85919 Sep 28 12:37:17.725484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-b964025a-db5c-423f-a493-1afd89ce9108 req-ea986d65-663d-4cca-9ea3-82983f1dfb1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046548 Sep 28 12:37:17.726121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 848/1668] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:37:17.730301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:17.739307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cfc3581e-4780-471c-b841-894779d6d246 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 200 len: 1465 microversion: 2.1 time: 0.113897 Sep 28 12:37:17.740062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 821/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:17 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 1465 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:17.937626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:17.938342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:17.944756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.945244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.945710 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:17.946345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:17.946788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:17.947212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.014942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:18.024392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-83d01d95-1f01-4441-9af4-a6f665c2dd58 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.090846 Sep 28 12:37:18.025007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 849/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:18.762939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:18.763480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 731779ea-c029-470d-af83-4091842d12f7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:18.770014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.770487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.770913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.771598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.772045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.772495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.786505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] HTTP exception thrown: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Request method failure captured: Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 HTTP/1.1 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDq3F-7RSfY0wBcwVqLJTwtNRwQawEk5rLEv8GXxyN21I6q5cUIq54utvRsdAm71ceCHcZd17rfssu7MPhKxLTLbeTm8bRbrRF6LA52WaetaGgc8JeHNNQUPGz3x-fOl0ZJz7kVDPWUZFGYWJv3YU-yk-0__NeVR-xSnIjp1WTR_Kiw Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:37:18.788120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47157b4286ac4ed5a24ba31bafd206a2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 956c7f92a4a747dba49e3f3a527bba74 Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. Sep 28 12:37:18.790065 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '731779ea-c029-470d-af83-4091842d12f7'} Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:37:18.791097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. Sep 28 12:37:18.792857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:37:18.794401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Returning 404 to user: Instance 731779ea-c029-470d-af83-4091842d12f7 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:37:18.794401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-dfd464f2-b2c4-4ed1-9fb7-b4d85b4ac89d tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7" status: 404 len: 111 microversion: 2.1 time: 0.030463 Sep 28 12:37:18.794401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 822/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:18 2022] GET /compute/v2.1/servers/731779ea-c029-470d-af83-4091842d12f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:37:18.798084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:18.798580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:18.805616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.806101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.806539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.807228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.807679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.808107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.832681 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:37:18.913954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-21f143a4-fc1f-4ae7-b64c-0c984f1d0814 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 204 len: 0 microversion: 2.1 time: 0.119366 Sep 28 12:37:18.914756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 850/1672] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:37:18 2022] DELETE /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:37:18.923989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:18.924626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:18.931246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.931743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.932172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:18.932885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:18.933331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:18.933749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.049065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:19.049864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:19.056356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.056827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.057256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.057946 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:19.058421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:19.058826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:19.063249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:19.070938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d7be005d-b74f-4636-92ac-edadf26c98b6 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1521 microversion: 2.1 time: 0.151083 Sep 28 12:37:19.071579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 823/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:18 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:19.122237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:19.130290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ed7e2be1-57be-4881-b395-13b471831887 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085568 Sep 28 12:37:19.130852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 851/1674] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:20.094316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:20.094880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:20.102224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.102696 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.103120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.104069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.104550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.104970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.153491 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:20.154182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:20.164174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.165004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.165638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.166356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.166812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.167235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.194682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956c7f92a4a747dba49e3f3a527bba74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47157b4286ac4ed5a24ba31bafd206a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:20.203900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-85b6208f-5027-4cae-ab38-b1714a91a2e5 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 200 len: 1479 microversion: 2.1 time: 0.113431 Sep 28 12:37:20.204513 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 824/1675] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:20 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 1479 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:20.234980 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb09cfc-7e3e-4928-ab77-6b692cbad71d", "name": "network-vif-deleted", "tag": "c95b849d-4e22-4734-acc8-e20b2732e38c"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:37:20.238895 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:20.247092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:20.247575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:20.247714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-58abb5c0-df1c-4f00-8210-91ae5e7ed0ef tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.098135 Sep 28 12:37:20.260597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 852/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:20 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:37:20.260800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:20.260800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] Creating event network-vif-deleted:c95b849d-4e22-4734-acc8-e20b2732e38c for instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d on hv-cinder-85919 Sep 28 12:37:20.267692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-a642f4e1-a3e1-4796-a747-ce6e96fe96e2 req-d6192758-3701-4700-bbdb-b18720f28138 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036335 Sep 28 12:37:20.268274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 825/1677] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:37:21.228044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:21.228944 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] [instance: 2fb09cfc-7e3e-4928-ab77-6b692cbad71d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:21.235496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.235976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.236443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:21.237161 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.237610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.238027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:21.241346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:21.254348 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] HTTP exception thrown: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Request method failure captured: Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d HTTP/1.1 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDq3F-7RSfY0wBcwVqLJTwtNRwQawEk5rLEv8GXxyN21I6q5cUIq54utvRsdAm71ceCHcZd17rfssu7MPhKxLTLbeTm8bRbrRF6LA52WaetaGgc8JeHNNQUPGz3x-fOl0ZJz7kVDPWUZFGYWJv3YU-yk-0__NeVR-xSnIjp1WTR_Kiw Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:37:21.256063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47157b4286ac4ed5a24ba31bafd206a2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47157b4286ac4ed5a24ba31bafd206a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 47157b4286ac4ed5a24ba31bafd206a2 Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1898901540 Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 956c7f92a4a747dba49e3f3a527bba74 Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1898901540-project Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. Sep 28 12:37:21.257865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '2fb09cfc-7e3e-4928-ab77-6b692cbad71d'} Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:37:21.258885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. Sep 28 12:37:21.260600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:37:21.262078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] Returning 404 to user: Instance 2fb09cfc-7e3e-4928-ab77-6b692cbad71d could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:37:21.262078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-47fd714a-effb-4888-ad35-15ddf6943f10 tempest-ServerRescueNegativeTestJSON-1898901540 tempest-ServerRescueNegativeTestJSON-1898901540-project] 10.222.0.26 "GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d" status: 404 len: 111 microversion: 2.1 time: 0.033332 Sep 28 12:37:21.262078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 853/1678] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:21 2022] GET /compute/v2.1/servers/2fb09cfc-7e3e-4928-ab77-6b692cbad71d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:37:21.272011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:21.272806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:21.279032 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.279593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.280086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:21.280865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:21.281375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:21.281951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:21.345648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:21.355614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a3619e20-2578-40df-9168-86a4af6cb473 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.088404 Sep 28 12:37:21.356183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 826/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:22.380382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:22.381756 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:22.393657 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:22.394148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:22.394585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:22.395298 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:22.395749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:22.396175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:22.495027 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:22.509157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-266ac46b-8860-413a-8845-20d26e5031e8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.134429 Sep 28 12:37:22.510075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 854/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:23.531977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:23.533082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:23.539734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.540991 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.541561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.542338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:23.542791 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:23.543239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:23.614844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:23.623744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-678cfd86-dccf-4a56-911d-478396c6953b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.095696 Sep 28 12:37:23.624900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 827/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:24.647610 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:24.648214 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:24.654695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.655165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.655591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.656386 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:24.657163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:24.657587 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:24.734858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:24.743508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a3efe5a1-32b7-4c8f-8366-4462b9dc70d8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.100200 Sep 28 12:37:24.744200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 855/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:25.766149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:25.766755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:25.773131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.773613 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.774039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.774719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:25.775167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:25.775590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:25.837990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:25.846355 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e400c91a-1066-4cd7-8691-d7c47ff61c78 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084063 Sep 28 12:37:25.850453 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 828/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:26.872839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:26.873366 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:26.880257 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:26.880774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:26.881209 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:26.881893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:26.882345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:26.882767 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:26.941826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:26.950278 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-aaf9541f-44ff-4a7e-848e-f61e0b743792 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081576 Sep 28 12:37:26.950878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 856/1684] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:27.974340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:27.974951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:27.981708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:27.982187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:27.982622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:27.983318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:27.983769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:27.984197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:28.044734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:28.052855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5806a676-440a-45d0-97f5-6ba67a1b804f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082913 Sep 28 12:37:28.053421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 829/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:29.075228 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:29.075882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:29.082363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:29.082833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:29.083290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:29.083996 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:29.084477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:29.084899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:29.146311 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:29.154451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e143a01c-f7f8-459b-a4ba-00be86faa1b3 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083064 Sep 28 12:37:29.155057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 857/1686] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:30.177644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:30.178188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:30.184854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:30.185331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:30.185796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:30.186480 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:30.186932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:30.187354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:30.250142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:30.259242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b5c2386-b37e-46eb-87d6-48f45d89bf7a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085456 Sep 28 12:37:30.259816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 830/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:31.282267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:31.282886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:31.290095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:31.290575 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:31.291011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:31.291703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:31.292154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:31.292609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:31.351408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:31.360065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-649a9752-295f-4110-a37f-d6be350ad478 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081671 Sep 28 12:37:31.360674 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 858/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:31 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:32.383674 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:32.384288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:32.390731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:32.391185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:32.391615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:32.392298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:32.392778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:32.393201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:32.452892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:32.461693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f99914e5-9323-4df7-8329-cb6adafa04c1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082415 Sep 28 12:37:32.462260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 831/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:33.484645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:33.485297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:33.491679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:33.492151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:33.492609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:33.493295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:33.493740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:33.494157 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:33.555282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:33.563350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0758c3bb-90be-4f84-87a5-c5962667f5f7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082568 Sep 28 12:37:33.563912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 859/1690] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:34.586778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:34.587379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:34.593846 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:34.594330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:34.594768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:34.595492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:34.595982 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:34.596631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:34.602019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=100 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:34.663381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:34.672036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5f3ea1cc-d2fd-49ad-abfc-9b7cf0fedff4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089243 Sep 28 12:37:34.672719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 832/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:35.695656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:35.696275 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:35.702737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:35.703223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:35.703658 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:35.704384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:35.704845 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:35.705270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:35.917738 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:35.925897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-48ac61af-65d8-40b0-bef6-9beed1af2741 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.234820 Sep 28 12:37:35.926473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 860/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:36.949767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:36.950375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:36.956268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:36.956774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:36.957201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:36.957879 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:36.958327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:36.958745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:37.019186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:37.027391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-37c74384-87ea-451e-ae09-09529e99054a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081614 Sep 28 12:37:37.027962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 833/1693] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:38.049368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:38.049972 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:38.056873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:38.057347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:38.057777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:38.058459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:38.058906 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:38.059327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:38.121828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:38.129940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-839951bf-b6be-4e4c-8a13-cddfa518c394 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084429 Sep 28 12:37:38.130490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 861/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:39.152695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:39.153292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:39.155556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=36 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:39.160990 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:39.161471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:39.162395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:39.163092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:39.163546 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:39.163971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:39.222715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:39.231379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19e946f2-8b0c-4b07-866f-50253922cb03 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082495 Sep 28 12:37:39.231945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 834/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:39 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:40.254714 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:40.255258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:40.262301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:40.262774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:40.263206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:40.263884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:40.264353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:40.264776 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:40.323602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:40.331641 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b250eac3-f646-446e-93d1-4339161cb0f5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080864 Sep 28 12:37:40.332198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 862/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:41.354439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:41.355046 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:41.362142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:41.362616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:41.363045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:41.363728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:41.364176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:41.364622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:41.424165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:41.434050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8106d646-ab5d-4ccb-95b1-1a0cd38e401a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083749 Sep 28 12:37:41.434615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 835/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:42.457184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:42.457792 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:42.464759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:42.465229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:42.465655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:42.466333 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:42.466772 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:42.467191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:42.527353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:42.535640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-662eaf15-9727-40a6-ab30-566bb04d2c70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082282 Sep 28 12:37:42.536196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 863/1698] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:43.558832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:43.559438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:43.565811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:43.566277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:43.566705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:43.567383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:43.567830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:43.568247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:43.630302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:43.638434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0c4e6b57-11d8-4935-8b4e-dd7e9ace41cc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083465 Sep 28 12:37:43.638997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 836/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:44.660276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:44.660833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:44.663107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:44.668443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:44.668919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:44.669354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:44.670306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:44.671081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:44.671811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:44.736652 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:44.745423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-90aeff4f-d7e9-4a60-8ea8-75509fad54d0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089074 Sep 28 12:37:44.745987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 864/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:45.768833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:45.769400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:45.776450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:45.776928 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:45.777358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:45.778454 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:45.778563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:45.779009 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:45.840364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:45.848404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8bd08759-fd77-4cb6-a123-5b2a28d89b9c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083474 Sep 28 12:37:45.848968 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 837/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:46.871435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:46.872051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:46.878586 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:46.879065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:46.879501 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:46.880191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:46.880673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:46.881101 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:46.942964 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:46.951126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-52a9e0ad-b9dc-4a75-9300-5a7a0d60560a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083590 Sep 28 12:37:46.951691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 865/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:47.974438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:47.975551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:47.982345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:47.982826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:47.983259 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:47.983957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:47.984464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:47.984891 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:48.044501 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:48.052671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c6eeef5-6f97-4eb8-9580-ffbdc0caf30a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082098 Sep 28 12:37:48.053837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 838/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:49.075650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:49.076262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:49.082782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:49.083263 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:49.083695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:49.084410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:49.084863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:49.085289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:49.146826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:49.154872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dead2457-47f6-4397-9ccf-50957f3811e2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083102 Sep 28 12:37:49.155428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 866/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:50.177481 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:50.178028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:50.184495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:50.184973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:50.185404 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:50.186087 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:50.186538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:50.186958 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:50.248622 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:50.257225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b5183327-0bbf-4ff7-9975-7a082ab3abbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083619 Sep 28 12:37:50.257787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 839/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:50 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:51.280881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:51.281496 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:51.288495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:51.288971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:51.289403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:51.290083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:51.290529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:51.290950 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:51.349023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:51.358044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-15da396a-9008-43b9-aaec-507019ac4d5b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080979 Sep 28 12:37:51.358648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 867/1706] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:52.379909 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:52.380543 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:52.387033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:52.387503 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:52.387931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:52.388641 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:52.389088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:52.389506 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:52.451064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:52.459196 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-78043587-68c9-4c53-ad38-28c305980bd7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083151 Sep 28 12:37:52.459797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 840/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:53.482677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:53.483290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:53.490156 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:53.490637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:53.491089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:53.491778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:53.492244 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:53.492696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:53.495337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=86 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:37:53.552884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:53.560916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f0adb6b8-b115-479f-bc47-7ea3d31742fd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082451 Sep 28 12:37:53.561482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 868/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:54.582945 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:54.583551 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:54.590643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:54.591112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:54.591538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:54.592220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:54.592692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:54.593111 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:54.653492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:54.661509 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-902ce97f-5b11-43a4-acdb-79aae44a117b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082407 Sep 28 12:37:54.662073 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 841/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:55.684544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:55.685159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:55.691551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:55.692029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:55.692498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:55.693183 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:55.694135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:55.694555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:55.760024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:55.768295 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d86f08a6-f4cc-4f0e-8701-f67608b108fc tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087759 Sep 28 12:37:55.768881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 869/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:56.790896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:56.791529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:56.798043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:56.798511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:56.798938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:56.799618 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:56.800062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:56.800512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:56.860485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:56.869184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47972959-ba3d-4b83-a24d-c8cae77348a5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082137 Sep 28 12:37:56.869758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 842/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:57.891691 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:57.892360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:57.894787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:37:57.894924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:37:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 (ip 10.222.0.26) !!! Sep 28 12:37:57.906059 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:57.906533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:57.906960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:57.907645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:57.908089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:57.908550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:57.969369 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:57.977886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4906a4e0-d136-488e-b1ea-73da8bc1cf97 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.090101 Sep 28 12:37:57.978452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 870/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:37:59.000799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:37:59.001424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:37:59.008575 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:59.009056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:59.009493 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:59.010187 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:37:59.010640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:37:59.011064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:37:59.071070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:37:59.079337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f39d18ed-4083-45c0-999a-dc6eaec4e059 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082346 Sep 28 12:37:59.079904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 843/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:37:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:00.101239 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:00.101846 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:00.108626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:00.109104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:00.109535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:00.110220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:00.110672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:00.111094 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:00.170127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:00.178184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-06550c1e-47ee-4fc2-8120-1851cb3790bd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080806 Sep 28 12:38:00.178741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 871/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:01.201717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:01.202311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:01.208830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:01.209803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:01.210239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:01.210926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:01.211375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:01.211797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:01.275786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:01.283933 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-23da882b-6422-4e80-b73f-e188cca6aec2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086080 Sep 28 12:38:01.284520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 844/1715] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:01 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:02.307788 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:02.308434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:02.314904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:02.315383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:02.315822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:02.316552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:02.317004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:02.317430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:02.377013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:02.385084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f1765656-490b-43c6-97ea-29e9d6943269 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081183 Sep 28 12:38:02.385650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 872/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:03.407721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:03.408344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:03.414892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:03.415365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:03.415794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:03.416522 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:03.416973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:03.417392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:03.477251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:03.485583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2cfc8096-b147-41a1-a3bb-c86c44a74041 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081685 Sep 28 12:38:03.486145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 845/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:04.509310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:04.509927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:04.516452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:04.516932 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:04.517377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:04.518066 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:04.518519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:04.518943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:04.586666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:04.594839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-79ccb099-1c8c-4773-8613-ea80df717fb7 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089875 Sep 28 12:38:04.595403 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 873/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:05.617924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:05.618554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:05.624565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:05.625042 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:05.625468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:05.626155 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:05.626599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:05.627016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:05.629683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:05.689788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:05.697979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ba9c72c8-bdcc-43ff-bf30-f8b4a7916333 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084062 Sep 28 12:38:05.698565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 846/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:06.721507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:06.722137 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:06.728781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:06.729526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:06.729960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:06.730654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:06.731102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:06.731525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:06.793698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:06.801863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-49f042e3-f5bf-412e-9dc8-d8288ef9989e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084291 Sep 28 12:38:06.802428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 874/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:07.825738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:07.826373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:07.832736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:07.833206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:07.833634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:07.834312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:07.834758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:07.835379 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:07.899134 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:07.907237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3038efc-c107-4a34-a15e-d3f48cd49a8d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085321 Sep 28 12:38:07.907794 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 847/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:08.929630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:08.930347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:08.936721 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:08.937195 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:08.937624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:08.938327 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:08.938773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:08.939190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:08.998564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:09.007345 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-778a1a15-1b10-4515-996e-8c5957eeaf38 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081042 Sep 28 12:38:09.007902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 875/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:10.030050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:10.030658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:10.033005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:10.039091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:10.039565 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:10.039996 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:10.040713 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:10.041163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:10.041592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:10.100189 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:10.109213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f2261952-80a4-4505-a3f9-58617cc5809b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083026 Sep 28 12:38:10.109778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 848/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:11.131014 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:11.131614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:11.138492 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:11.138961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:11.139388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:11.140060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:11.140602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:11.141023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:11.200323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:11.208629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a0b81dec-adc3-490f-b425-934203829ab4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081459 Sep 28 12:38:11.209186 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 876/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:12.233068 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:12.233625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:12.240078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:12.240589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:12.241052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:12.241718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:12.242171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:12.242633 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:12.302492 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:12.310583 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65128f53-4292-487c-a2df-94bff44538f6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081683 Sep 28 12:38:12.311151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 849/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:12 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:13.333412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:13.334281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:13.341036 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:13.341508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:13.341936 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:13.342611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:13.343055 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:13.343475 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:13.406200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:13.414881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c158c3b1-f553-49c6-a1c6-329648f1c8bb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085299 Sep 28 12:38:13.415486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 877/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:14.437786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:14.438387 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:14.445443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:14.445913 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:14.446336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:14.447015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:14.447457 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:14.447874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:14.507444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:14.515616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-5b7be1b4-f57a-4547-b458-bcd3b6cb8da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081647 Sep 28 12:38:14.516188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 850/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:15.537703 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:15.538942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:15.541343 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:15.547115 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:15.547629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:15.548065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:15.548795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:15.549246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:15.549670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:15.610175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:15.618273 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-80f33f08-16e2-4b4f-9004-bb32106bb04b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084409 Sep 28 12:38:15.618859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 878/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:15 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:16.641350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:16.641936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:16.648274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:16.648776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:16.649204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:16.649884 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:16.650331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:16.650745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:16.712955 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:16.720938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-84a6c338-35f5-4a06-9c57-b45d279a1fa8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083479 Sep 28 12:38:16.721512 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 851/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:16 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:17.744347 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:17.744907 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:17.751191 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:17.751661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:17.752085 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:17.752793 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:17.753235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:17.753649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:17.812531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:17.821149 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b57f0620-6b9d-433c-8878-6e1580e0be70 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081231 Sep 28 12:38:17.821712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 879/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:17 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:18.843785 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:18.844449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:18.850801 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:18.851270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:18.851699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:18.852408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:18.852857 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:18.853274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:18.912496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:18.920710 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-47194478-8786-487e-be2f-f8992a156651 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080725 Sep 28 12:38:18.921298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 852/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:18 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:19.942881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:19.943489 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:19.949879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:19.950352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:19.950778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:19.951482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:19.951925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:19.952360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:20.012251 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:20.020532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-484712e6-5c09-4627-8e53-58c5b2ebb4e6 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081412 Sep 28 12:38:20.021112 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 880/1732] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:19 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:21.044532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:21.045159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:21.051599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:21.052072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:21.052534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:21.053221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:21.054298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:21.054725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:21.118485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:21.126610 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91d08833-e383-4830-aea8-ce1f3f0492a8 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086026 Sep 28 12:38:21.127176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 853/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:21 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:22.149588 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:22.150256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:22.156719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:22.157197 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:22.157631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:22.158315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:22.158765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:22.159185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:22.222338 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:22.231359 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-420bab31-a2e9-4e62-9784-0a51d6d8e9cd tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.086116 Sep 28 12:38:22.231921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 881/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:22 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:23.255699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:23.256344 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:23.263429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:23.263912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:23.264374 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:23.265070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:23.265553 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:23.265979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:23.325554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:23.333789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2c1d6ff1-d0ee-4417-afce-ae23c4b0e9c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081948 Sep 28 12:38:23.334367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 854/1735] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:23 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:24.358181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:24.358903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:24.365582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:24.366548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:24.366980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:24.367675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:24.368125 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:24.368581 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:24.371178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=84 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:24.428730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:24.436842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b300bd79-86b1-472f-99e3-abe3c71c2889 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082845 Sep 28 12:38:24.437406 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 882/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:24 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:25.460638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:25.461270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:25.467717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:25.468185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:25.468640 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:25.469316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:25.469760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:25.470178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:25.532324 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:25.540886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff34ca2c-0d20-4f29-a49a-742b451281b0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084165 Sep 28 12:38:25.541441 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 855/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:25 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:26.563385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:26.563997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:26.570577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:26.571058 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:26.571486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:26.572174 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:26.572656 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:26.573081 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:26.635490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:26.643654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-616d045b-c1c3-4007-b30b-433bbfca9565 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084185 Sep 28 12:38:26.644215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 883/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:26 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:27.666974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:27.667584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:27.674100 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:27.674572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:27.675001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:27.675688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:27.676139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:27.676591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:27.735970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:27.744037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bc8bb127-b2c1-4c55-a60f-4de1de5fc9d1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080926 Sep 28 12:38:27.744690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 856/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:27 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:28.767050 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:28.767635 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:28.773989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:28.774462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:28.774891 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:28.775571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:28.776016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:28.776476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:28.835346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:28.843536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-adbab118-1061-487c-90f5-aa64d6c6b23e tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080420 Sep 28 12:38:28.844100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 884/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:28 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:29.867302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:29.867906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:29.874532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:29.875003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:29.875431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:29.876108 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:29.876586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:29.877004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:29.936442 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:29.944573 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fd32a19c-7c98-40cd-86f9-e585b9a85958 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081705 Sep 28 12:38:29.945135 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 857/1741] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:29 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:30.966994 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:30.967599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:30.973965 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:30.974431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:30.974856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:30.976159 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:30.976629 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:30.977047 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:31.039253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:31.047382 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fc4fd375-e1c3-4b8b-a223-aaf3f56d4c74 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084281 Sep 28 12:38:31.047939 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 885/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:30 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:32.069614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:32.070248 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:32.076724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:32.077194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:32.077652 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:32.078331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:32.078782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:32.079201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:32.144494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:32.152920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fdaeac1d-83e2-4b90-98b9-18929088b922 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.087734 Sep 28 12:38:32.153523 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 858/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:32 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:33.175817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:33.176464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:33.183361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:33.183830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:33.184256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:33.184954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:33.185398 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:33.185813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:33.245744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:33.254044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4df101ba-ca00-428a-b344-a941cc4cd920 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082126 Sep 28 12:38:33.254620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 886/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:33 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:34.276347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:34.276904 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:34.283307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:34.283784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:34.284219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:34.284931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:34.285381 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:34.285806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:34.347598 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:34.356456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ddf698bb-1dcd-483d-9db9-7e77d7a2366f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084062 Sep 28 12:38:34.357214 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 859/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:34 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:35.380044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:35.380668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:35.387614 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:35.388153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:35.388660 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:35.389355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:35.389816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:35.390242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:35.452006 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:35.460167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-45c9f8df-8694-40b1-bdc6-914c49d7f8a1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084153 Sep 28 12:38:35.460762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 887/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:35 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:36.483188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:36.483775 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:36.490184 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:36.491165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:36.491596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:36.492288 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:36.492768 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:36.493188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:36.495833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:36.802366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:36.811168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-80b04392-28ee-46f9-968d-15ddf117d846 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.332081 Sep 28 12:38:36.811730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 860/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:36 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:38:37.833963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:37.834576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:37.840749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:37.841255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:37.841685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:37.842367 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:37.842813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:37.843233 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:37.902665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:37.910787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5e853ea5-1e70-437d-87ea-a7c07bac98c5 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080825 Sep 28 12:38:37.911354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 888/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:37 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:38.933291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:38.933902 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:38.940270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:38.940806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:38.941241 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:38.941929 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:38.942383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:38.942805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:39.002036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:39.010647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-19599355-dfe7-48bf-b8ef-2c6fbe11ebba tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081224 Sep 28 12:38:39.011201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 861/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:38 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:40.033768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:40.034385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:40.041495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:40.041971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:40.042401 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:40.043088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:40.043568 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:40.043989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:40.106782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:40.114927 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-30baa698-e4ef-49cf-833b-31b6f856691a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085014 Sep 28 12:38:40.115493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 889/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:40 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:41.136767 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:41.137371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:41.139727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:41.145168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:41.145650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:41.146084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:41.146779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:41.147235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:41.147660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:41.206867 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:41.214956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ff88abe9-7e18-4597-b98f-5527439e594f tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082032 Sep 28 12:38:41.215526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 862/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:41 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:42.240121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:42.240679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:42.247316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:42.247796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:42.248226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:42.248933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:42.249378 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:42.249799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:42.308688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:42.316815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd5dc8bd-6d4f-45a6-94bf-8b92187e98ee tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080594 Sep 28 12:38:42.317381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 890/1752] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:42 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:43.339228 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:43.339832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:43.346268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:43.346742 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:43.347172 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:43.347861 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:43.348334 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:43.348766 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:43.408428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:43.417186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fa61ce69-8d3f-4910-8d6b-ac51c0592c05 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081791 Sep 28 12:38:43.417764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 863/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:43 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:44.439643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:44.440246 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:44.446632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:44.447104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:44.447527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:44.448205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:44.448677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:44.449090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:44.508819 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:44.517052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-834d1f1e-b0c1-488b-a56d-2c86c446516c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081299 Sep 28 12:38:44.517615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 891/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:44 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:45.541240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:45.541837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:45.548340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:45.548817 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:45.549250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:45.549992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:45.550443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:45.550863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:45.612840 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:45.621607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-101e06de-1c37-4697-bc5e-746625c34ce4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084214 Sep 28 12:38:45.622176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 864/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:45 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:46.644231 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:46.644886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:46.647838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=28 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:46.653052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:46.653523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:46.653952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:46.654639 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:46.655089 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:46.655509 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:46.714616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:46.722638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a8213d7-f9fd-41af-8e9f-1b8fc831b671 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082262 Sep 28 12:38:46.723200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 892/1756] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:46 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:47.745624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:47.746203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:47.752779 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:47.753253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:47.753685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:47.754373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:47.754825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:47.755246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:47.818849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:47.831433 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-509dd837-c7e1-45c0-b554-c23d049b038a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.089745 Sep 28 12:38:47.832002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 865/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:47 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:48.855637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:48.856249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:48.862698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:48.863198 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:48.863625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:48.864362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:48.864807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:48.865841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:48.928702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:48.937024 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cbb15322-3850-4d82-826a-3cd0f8f9fd1c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085476 Sep 28 12:38:48.937599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 893/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:48 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:49.959063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:49.959673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:49.966136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:49.966604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:49.967033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:49.967708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:49.968152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:49.968592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:50.027829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:50.035818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-42104fae-2178-48ad-9a20-db9c47f94da4 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080641 Sep 28 12:38:50.036398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 866/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:49 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:51.059016 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:51.059631 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:51.066048 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.066526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.066960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.067643 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:51.068091 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:51.068563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:51.128199 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:51.136215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cf46ef9f-b89a-463d-b8cb-32bc2fb0a9b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081119 Sep 28 12:38:51.136810 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 894/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:51 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:52.159160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:52.159786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:52.166185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:52.166657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:52.167091 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:52.167769 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:52.168213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:52.168657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:52.229250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:52.237604 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-64a77334-a711-4e56-abf8-729ecc7ec237 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082328 Sep 28 12:38:52.238163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 867/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:52 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:53.261007 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:53.261603 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:53.268019 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:53.268533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:53.268973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:53.269683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:53.270130 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:53.270551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:53.329741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:53.337856 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-26e7336d-b1dc-4c01-b965-4c2da32e94e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080767 Sep 28 12:38:53.338419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 895/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:53 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:54.361681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:54.362335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:54.369139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:54.369614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:54.370045 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:54.370736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:54.371182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:54.371614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:54.432939 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:54.440880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b2c895e3-b6d2-4122-b962-345f9e16bb28 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083255 Sep 28 12:38:54.441446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 868/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:54 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:55.464813 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:55.465410 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:55.471808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:55.472280 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:55.472739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:55.473425 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:55.473914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:55.474784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:55.477320 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=84 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:38:55.535062 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:55.543490 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cb2bc9a9-536b-4ef3-af35-86f92e7ddc7c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082643 Sep 28 12:38:55.544052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 896/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:55 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:56.567245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:56.567885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:56.574353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:56.574829 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:56.575266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:56.575956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:56.576430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:56.576854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:56.636616 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:56.644798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-81933a14-8aba-4e8d-a83b-c0ab9ca402fb tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081299 Sep 28 12:38:56.645362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 869/1765] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:56 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:57.667864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:57.668522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:57.674978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:57.675453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:57.675887 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:57.676602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:57.677049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:57.677472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:57.741368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:57.749517 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b17caca6-8d0a-4b45-877a-5fdbeaa5afae tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085479 Sep 28 12:38:57.750021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 897/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:57 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:58.772998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:58.773554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:58.779936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:58.780444 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:58.780877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:58.781556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:58.782025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:58.782428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:58.842702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:58.851520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb5acd26-d0b7-4de8-99e6-43dd77b0db43 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082952 Sep 28 12:38:58.852093 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 870/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:58 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:38:59.874599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:38:59.875211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:38:59.881897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:59.882373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:59.882805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:59.883499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:38:59.883952 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:38:59.884404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:38:59.943847 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:38:59.952025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0cd80f0a-027c-45af-99a9-658f07e1d4e1 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081284 Sep 28 12:38:59.952627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 898/1768] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:38:59 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:00.974997 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:00.975632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:00.982222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.982690 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.983115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:00.983802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:00.984245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:00.984684 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:01.043676 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:01.051800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac540ee9-b786-4124-98b6-e69b523df2e0 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081252 Sep 28 12:39:01.052373 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 871/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:00 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:02.074886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:02.075589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:02.082136 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:02.082612 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:02.083045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:02.083728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:02.084178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:02.084637 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:02.143980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:02.151948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-00b2f9ef-801c-4123-a62e-4472d9ff720d tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.080920 Sep 28 12:39:02.152536 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 899/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:02 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:03.175035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:03.175635 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:03.183131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.183609 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.184038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.184755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:03.185204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:03.185623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:03.248129 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:03.256169 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9d36e06-c2d7-4d3f-b0b8-432395baddbf tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084960 Sep 28 12:39:03.256760 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 872/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:03 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:04.279041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:04.279654 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:04.286193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.286786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.287219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.287904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:04.288371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:04.288796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:04.347705 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:04.356644 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5add7e93-8472-4010-80ea-039e9c72f2ad tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081489 Sep 28 12:39:04.357211 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 900/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:04 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:05.379680 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:05.380497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:05.389383 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:05.389862 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:05.390300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:05.391006 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:05.391636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:05.392340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:05.452901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:05.461416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f6a46c2-792f-4f10-8da6-ae7df6e1da8b tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.085779 Sep 28 12:39:05.461973 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 873/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:05 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:06.484970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:06.485554 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:06.491495 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:06.491963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:06.492412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:06.493107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:06.493547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:06.493967 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:06.556134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:06.564212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-974e52ce-8fc5-4fde-ba31-eca0cb7129b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.083247 Sep 28 12:39:06.564822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 901/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:06 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:07.586797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:07.587406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:07.593870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:07.594348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:07.594786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:07.595474 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:07.595926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:07.596376 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:07.599402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=84 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:07.656898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:07.665495 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b33c39fe-0b1b-43c3-8ce7-6dee15bff96a tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082587 Sep 28 12:39:07.666059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 874/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:07 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:08.688771 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:08.689397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:08.696375 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:08.696860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:08.697297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:08.697998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:08.698448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:08.698877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:08.759261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:08.767577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e9f27894-2870-4eb8-b8fe-f9be7195a4b9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082694 Sep 28 12:39:08.768145 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 902/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:08 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:09.792289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:09.792938 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:09.798925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:09.799403 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:09.799837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:09.800555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:09.801013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:09.801436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:09.861856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:09.870656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c8b07a69-868c-42dd-afad-4591fa0336d2 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.084061 Sep 28 12:39:09.871229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 875/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:09 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:10.894022 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:10.894655 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:10.901061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:10.901512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:10.901940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:10.902616 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:10.903057 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:10.903500 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:10.963004 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:10.971429 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b9b4c6e0-9b87-4cee-a6f1-d63a847f37a9 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081704 Sep 28 12:39:10.971992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 903/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:10 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:11.994470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:11.995082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:11.997434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=28 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:12.002672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.003162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.003594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.004286 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:12.004782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:12.005708 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:12.064335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:12.072851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-91c68cf8-f246-461a-a8d8-273f19ab930c tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.082249 Sep 28 12:39:12.073447 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 876/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:11 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:13.096148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:13.096777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:13.103699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:13.104170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:13.104636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:13.105578 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:13.106025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:13.106445 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:13.166097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:13.174133 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4d05b1d3-95d1-4c95-b585-a6e0006fcf88 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081888 Sep 28 12:39:13.174694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 904/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:13 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:14.197459 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:14.198069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] [instance: 4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:14.204554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:14.204983 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:14.205417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:14.206106 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:14.206559 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:14.206985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:14.266340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4226c61349b440c3a502a7cbc592d883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e271418048c1466e948bf84de04fc05f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:39:14.274435 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c2fc3f9-d7d8-48ce-ac6d-c5ebe5e10d75 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84" status: 200 len: 1388 microversion: 2.1 time: 0.081439 Sep 28 12:39:14.275011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 877/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:14 2022] GET /compute/v2.1/servers/4fe70d54-d8ac-49b6-bbd4-bf7f7c01ee84 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:39:14.296093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-47057cc0-94df-464e-ad7b-77083f67e205 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] Calling method '.version_select at 0x7f3062683430>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:14.317702 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-47057cc0-94df-464e-ad7b-77083f67e205 tempest-TestMinimumBasicScenario-218185046 tempest-TestMinimumBasicScenario-218185046-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-581878132" status: 202 len: 0 microversion: 2.1 time: 0.025338 Sep 28 12:39:14.318253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 905/1782] 10.222.0.26 () {58 vars in 1269 bytes} [Wed Sep 28 12:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-581878132 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:39:16.716013 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:16.716621 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:16.723589 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.724408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.725094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.725974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.726787 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.727530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.744297 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e HTTP/1.1 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:39:16.746225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.748577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '6193f7a3-88d5-468f-ab3c-6e94ce08555e'} Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:16.749877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.751669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.753252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:16.753252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-df56df0e-31d7-43cd-b58f-80dad11cebcb tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 404 len: 111 microversion: 2.20 time: 0.035800 Sep 28 12:39:16.759640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:16.760135 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 6193f7a3-88d5-468f-ab3c-6e94ce08555e] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:16.763198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 878/1783] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 28 12:39:16 2022] DELETE /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:39:16.768370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:39:16.770427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.770954 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.772698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.773482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.773945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.774416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.793499 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e HTTP/1.1 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:39:16.795226 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.797258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '6193f7a3-88d5-468f-ab3c-6e94ce08555e'} Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:16.798269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. Sep 28 12:39:16.799888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.804381 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 6193f7a3-88d5-468f-ab3c-6e94ce08555e could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:16.805486 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e91c5ff7-5e63-4a67-b760-3a9c14b6b3ad tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e" status: 404 len: 111 microversion: 2.20 time: 0.052846 Sep 28 12:39:16.806234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 906/1784] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:39:16 2022] GET /compute/v2.1/servers/6193f7a3-88d5-468f-ab3c-6e94ce08555e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:39:16.872724 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:16.874849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:16.883678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.884253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.885043 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.885823 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.886532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.887034 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.905691 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c HTTP/1.1 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:39:16.907416 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.909310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '556dc44e-ec85-4db2-8d42-c203c19a303c'} Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:16.910352 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.912079 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.913956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:16.914556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4af4c689-8845-41d9-9b78-b5645fd7b0a9 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 404 len: 111 microversion: 2.1 time: 0.047816 Sep 28 12:39:16.916375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 879/1785] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:39:16 2022] DELETE /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:39:16.923903 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:39:16.924707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 556dc44e-ec85-4db2-8d42-c203c19a303c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:39:16.931051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.931858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.932391 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.933082 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:39:16.933970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:39:16.934483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:39:16.949430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c HTTP/1.1 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:39:16.950976 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.952970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '556dc44e-ec85-4db2-8d42-c203c19a303c'} Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:39:16.953865 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. Sep 28 12:39:16.955270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:39:16.956555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 556dc44e-ec85-4db2-8d42-c203c19a303c could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:39:16.956555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0e97bd60-334b-456b-aaf9-33dc5c637917 tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c" status: 404 len: 111 microversion: 2.1 time: 0.033086 Sep 28 12:39:16.956555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 907/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:39:16 2022] GET /compute/v2.1/servers/556dc44e-ec85-4db2-8d42-c203c19a303c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:41:18.545892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=7 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:41:18.547476 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=27 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:41:18.550660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:41:18.551681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:41:18.556058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:41:18.556580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:41:18.559070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:41:18.559590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:41:18.892182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70275a6-f5ea-4b01-b384-32c64c06551d", "name": "network-vif-deleted", "tag": "c0641157-82d8-42ba-a37f-1a65ad219c3a"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:41:18.904511 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:41:18.905118 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:41:18.905651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:41:18.917212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] Creating event network-vif-deleted:c0641157-82d8-42ba-a37f-1a65ad219c3a for instance f70275a6-f5ea-4b01-b384-32c64c06551d on hv-cinder-85919 Sep 28 12:41:18.923319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-1bea8325-e6d4-4f01-a27e-45d5881e9ec5 req-a027644f-db71-491e-bffe-962ea02fbb29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388263 Sep 28 12:41:18.924038 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 880/1787] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:43:17.919119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:43:17.919808 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=3 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:43:17.921682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=57 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:43:17.922697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:43:17.923052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf (ip 10.222.0.26) !!! Sep 28 12:43:17.925013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:43:17.925153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf (ip 10.222.0.26) !!! Sep 28 12:43:17.927521 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:43:17.927822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf (ip 10.222.0.26) !!! Sep 28 12:43:17.936144 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:43:17.936664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:43:17.957930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:17.958498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:17.959178 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:17.960187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:17.960780 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:17.961356 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:17.990286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:43:18.072933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5fb04aff-e7c8-47e7-8e47-51f36899bee7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 204 len: 0 microversion: 2.1 time: 0.155408 Sep 28 12:43:18.073894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 908/1788] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:43:17 2022] DELETE /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:43:18.081156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:43:18.081831 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:43:18.082919 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:43:18.089225 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:43:18.089930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:43:18.097326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:18.097802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:18.098428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:18.099123 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:18.099577 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:18.100005 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:18.473776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:43:18.482059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bb34227f-976b-4b7a-b129-01e82b4bf6dd tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1683 microversion: 2.1 time: 0.403249 Sep 28 12:43:18.482946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 881/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:43:18 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1683 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:43:19.507715 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:43:19.508546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:43:19.517968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:19.518698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:19.519190 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:19.520029 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:19.520573 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:19.527692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:19.556602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50776. Sep 28 12:43:19.624872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53829cee-0c58-44b4-84d2-4f47a4167cdf", "name": "network-vif-deleted", "tag": "2ce478a9-16be-4657-b216-da2bf09b2976"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:43:19.644000 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:19.645076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:19.645723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:19.667517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] Creating event network-vif-deleted:2ce478a9-16be-4657-b216-da2bf09b2976 for instance 53829cee-0c58-44b4-84d2-4f47a4167cdf on hv-cinder-85919 Sep 28 12:43:19.673349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-2da7f193-5c65-4f21-83b8-af18cdefd3f9 req-50d0c13f-7b20-4923-a851-0a1ef5306b91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052182 Sep 28 12:43:19.678463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 882/1790] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:43:19.866953 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a8818fd59954480bcff68b9ba52769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f514e581a3473188c0ca78416919a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:43:19.876111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-86f46975-6ed3-42ba-9caf-55c18bbdb0ae tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 200 len: 1615 microversion: 2.1 time: 0.372449 Sep 28 12:43:19.887168 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 909/1791] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:43:19 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 1615 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:43:20.911686 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:43:20.912500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:43:20.919665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50788. Sep 28 12:43:20.921745 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:20.922325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:20.922837 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:20.923607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:43:20.924122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:43:20.924688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:43:20.940221 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf HTTP/1.1 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:43:20.941894 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:43:20.943170 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '53829cee-0c58-44b4-84d2-4f47a4167cdf'} Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:43:20.943880 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:43:20.945330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:43:20.947146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:43:20.947146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8f08e21a-7d5f-4576-8a0a-62c18dbd79b7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 404 len: 111 microversion: 2.1 time: 0.036020 Sep 28 12:43:20.947545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 883/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:43:20 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:43:20.953045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b9647931-3cae-4598-a337-9ac0cd8d6a9d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '.version_select at 0x7f30626fa790>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:43:20.979175 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b9647931-3cae-4598-a337-9ac0cd8d6a9d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098914681" status: 202 len: 0 microversion: 2.1 time: 0.030484 Sep 28 12:43:20.980591 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 910/1793] 10.222.0.26 () {58 vars in 1221 bytes} [Wed Sep 28 12:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098914681 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:47:17.089177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:47:17.089924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:17.090649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=10 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:17.091651 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:47:17.091809 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.093741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:47:17.093878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.095351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:47:17.095498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.102084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:17.102623 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:47:17.114952 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.115426 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.115856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.116570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.117019 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.117439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.131764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 HTTP/1.1 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:47:17.133371 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.134636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '7dafad59-8746-4b43-9873-444b28b0da27'} Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:17.135337 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.136464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.137484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:17.137484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6551cd5-4306-46c8-91f5-4729954fb56c tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 404 len: 111 microversion: 2.1 time: 0.047446 Sep 28 12:47:17.137484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 884/1794] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:47:17 2022] DELETE /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:47:17.141044 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:47:17.141589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:17.142312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:17.143234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:47:17.143373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.144542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:47:17.144669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.145694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:47:17.145794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:47:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 (ip 10.222.0.26) !!! Sep 28 12:47:17.154732 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:17.155336 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] [instance: 7dafad59-8746-4b43-9873-444b28b0da27] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:47:17.166368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.166853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.167328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.168023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.168494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.168915 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.183318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] HTTP exception thrown: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Request method failure captured: Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 HTTP/1.1 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDq-wLcLbc7lL03ErYc_2ZzmfEjE4zGWa41Ht6aKEJIqRUeghizOANBVlw3VqXat7enBXLAngPHZD-jYcrMLvRGf2uFnuq6BKYOQNehLaZCQIpcgBG0DI8v7D8xGUD7k1wsXKolN8BgKjjm8eGJ58yXTLkOepYileHhEus8VVFeQVPw Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:17.185018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7f6e096c5a54a7ebc843b012e82e0f4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7f6e096c5a54a7ebc843b012e82e0f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: f7f6e096c5a54a7ebc843b012e82e0f4 Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1739377182 Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: fdb0f345d2e04483b5166e1eb728bf91 Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeTestJSON-1739377182-project Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.186151 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '7dafad59-8746-4b43-9873-444b28b0da27'} Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:17.186750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. Sep 28 12:47:17.187844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.188921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] Returning 404 to user: Instance 7dafad59-8746-4b43-9873-444b28b0da27 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:17.188921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bfe6933d-318d-43fb-aeb1-87a56b70b50d tempest-AttachVolumeTestJSON-1739377182 tempest-AttachVolumeTestJSON-1739377182-project] 10.222.0.26 "GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27" status: 404 len: 111 microversion: 2.1 time: 0.046991 Sep 28 12:47:17.188921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 911/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:47:17 2022] GET /compute/v2.1/servers/7dafad59-8746-4b43-9873-444b28b0da27 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:47:17.226924 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:17.227423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:47:17.233325 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.233960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.234232 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.235171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.235630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.236052 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.250341 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee HTTP/1.1 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:47:17.251898 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.253985 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '300ee327-113a-408e-8cee-099a7cc2a0ee'} Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:17.254993 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.256335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.257554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:17.264703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7ade8f34-4d69-4a2c-9367-d0f66974b917 tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "DELETE /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 404 len: 111 microversion: 2.20 time: 0.032146 Sep 28 12:47:17.265450 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 885/1796] 10.222.0.26 () {60 vars in 1280 bytes} [Wed Sep 28 12:47:17 2022] DELETE /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:47:17.273162 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:17.273768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] [instance: 300ee327-113a-408e-8cee-099a7cc2a0ee] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:47:17.280001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.280522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.280960 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.281675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:47:17.282126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:47:17.282548 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:47:17.298680 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] HTTP exception thrown: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Request method failure captured: Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee HTTP/1.1 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrE4NdwDmeMwywlLA3rLFI8OG7Ag8AQnRDSNfoTAN83HgJnXBgtejlFoirLS_RK2peofm-Tut2esqtW73Vw-nnAw0lo6XRGL0LXdNYJikpOpGkRZ0BR4nGLX4DJh1abciJu1jpUeq4VfyiB1H8qWTIXOAFxeS9RDV54kL09GCpeMG4 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:17.301423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ba288a6bdc4e41729bd679733eaee61e", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ba288a6bdc4e41729bd679733eaee61e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: ba288a6bdc4e41729bd679733eaee61e Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791779883 Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 820f4bb963644499a77fa1f3edd59d08 Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791779883-project Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.302664 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '300ee327-113a-408e-8cee-099a7cc2a0ee'} Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:17.303301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. Sep 28 12:47:17.304497 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:17.305397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] Returning 404 to user: Instance 300ee327-113a-408e-8cee-099a7cc2a0ee could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:17.305397 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9e66b86f-6a2a-4cd6-ada4-0a1680f1a5ff tempest-AttachVolumeShelveTestJSON-791779883 tempest-AttachVolumeShelveTestJSON-791779883-project] 10.222.0.26 "GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee" status: 404 len: 111 microversion: 2.20 time: 0.033554 Sep 28 12:47:17.307487 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 912/1797] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Sep 28 12:47:17 2022] GET /compute/v2.1/servers/300ee327-113a-408e-8cee-099a7cc2a0ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:47:24.252521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53294. Sep 28 12:47:24.255576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53292. Sep 28 12:47:24.407688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4b97dfa5-ea13-4d6a-b145-0ab24e42fefc tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Action: 'create', calling method: .version_select at 0x7f306263a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-783259885", "metadata": {"Type": "work"}}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:47:24.416396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-54b05ee8-699c-4089-9eac-ee865ef55743 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Action: 'create', calling method: .version_select at 0x7f306264a430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-723604539", "metadata": {"Type": "work"}}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-54b05ee8-699c-4089-9eac-ee865ef55743 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 121 Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.424222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-723604539", "metadata": {"Type": "work"}}} Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.425615 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-723604539', 'metadata': {'Type': 'work'}}}} Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.426466 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:47:24.427990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:47:24.430472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 12:47:24.430472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.430472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-54b05ee8-699c-4089-9eac-ee865ef55743 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.430472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-54b05ee8-699c-4089-9eac-ee865ef55743 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.186490 Sep 28 12:47:24.430472 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 913/1798] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 28 12:47:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:47:24.435326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed2d67bf-fc33-46f8-80bd-51d76f8afd99 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Action: 'create', calling method: .version_select at 0x7f306269ad30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2091184067", "metadata": {"Type": "work"}}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed2d67bf-fc33-46f8-80bd-51d76f8afd99 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 120 Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.440574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2091184067", "metadata": {"Type": "work"}}} Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.441938 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2091184067', 'metadata': {'Type': 'work'}}}} Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi '0' Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.442798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:47:24.444243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:47:24.445485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 12:47:24.445485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.445485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ed2d67bf-fc33-46f8-80bd-51d76f8afd99 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.445485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ed2d67bf-fc33-46f8-80bd-51d76f8afd99 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010439 Sep 28 12:47:24.446455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 914/1799] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 28 12:47:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:47:24.450734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0d2836aa-beb5-432b-a432-1d2252255385 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Action: 'create', calling method: .version_select at 0x7f3065df8310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-89368306", "metadata": {"Type": "work"}}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0d2836aa-beb5-432b-a432-1d2252255385 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 117 Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.454090 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-89368306", "metadata": {"Type": "work"}}} Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.456002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-89368306', 'metadata': {'Type': 'work'}}}} Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise error Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi '' Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.456868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 12:47:24.458288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 12:47:24.459661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 12:47:24.459661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.459661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0d2836aa-beb5-432b-a432-1d2252255385 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.459661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0d2836aa-beb5-432b-a432-1d2252255385 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008044 Sep 28 12:47:24.459661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 915/1800] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 28 12:47:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 12:47:24.468180 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3968df0-1456-4287-bb32-a84db8770fbd tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Calling method '.version_select at 0x7f3065da58b0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:24.671127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-b3968df0-1456-4287-bb32-a84db8770fbd tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] HTTP exception thrown: Volume tempest-invalid-54025588 could not be found. Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3968df0-1456-4287-bb32-a84db8770fbd tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-54025588 HTTP/1.1 Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.673426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Volume tempest-invalid-54025588 could not be found. Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': 'tempest-invalid-54025588'} Sep 28 12:47:24.674870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-54025588 could not be found. (HTTP 404) (Request-ID: req-559e88b7-4d91-4934-965b-4a45b6d9ccf6) Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.676009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:47:24.677352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-54025588 could not be found. Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:24.678653 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-54025588 could not be found. Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-54025588 could not be found. Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.679918 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b3968df0-1456-4287-bb32-a84db8770fbd tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 404 to user: Volume tempest-invalid-54025588 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.680739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b3968df0-1456-4287-bb32-a84db8770fbd tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-54025588" status: 404 len: 97 microversion: 2.1 time: 0.214711 Sep 28 12:47:24.683035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 916/1801] 10.222.0.26 () {58 vars in 1212 bytes} [Wed Sep 28 12:47:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-54025588 => generated 97 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 28 12:47:24.692379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5c1f8c1a-4be6-4488-8173-2e97241236a0 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003900 Sep 28 12:47:24.692990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 917/1802] 10.222.0.26 () {58 vars in 1140 bytes} [Wed Sep 28 12:47:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 12:47:24.701720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7d89c6cf-4db1-4715-8132-7baae767ad06 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003555 Sep 28 12:47:24.706384 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 918/1803] 10.222.0.26 () {58 vars in 1137 bytes} [Wed Sep 28 12:47:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 12:47:24.711530 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b86c016-5920-413a-a0b9-19e9ddcfa46e tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Calling method '.version_select at 0x7f3065da5ee0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:24.717628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4b97dfa5-ea13-4d6a-b145-0ab24e42fefc tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.478028 Sep 28 12:47:24.718940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 886/1804] 10.222.0.26 () {60 vars in 1156 bytes} [Wed Sep 28 12:47:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 480 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 12:47:24.731926 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da702a0b-8a23-417a-9f16-b43aefcc3ae7 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d570d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:24.778571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-3b86c016-5920-413a-a0b9-19e9ddcfa46e tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] HTTP exception thrown: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b86c016-5920-413a-a0b9-19e9ddcfa46e tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: DELETE /compute/v2.1/os-volumes/0dda5435-2b53-47d8-87f9-da9f8789ce62 HTTP/1.1 Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.780562 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '0dda5435-2b53-47d8-87f9-da9f8789ce62'} Sep 28 12:47:24.781912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. (HTTP 404) (Request-ID: req-ef7fd0da-6d44-4a67-8a72-83b507945c00) Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.782977 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 12:47:24.784774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 12:47:24.785864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b86c016-5920-413a-a0b9-19e9ddcfa46e tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 404 to user: Volume 0dda5435-2b53-47d8-87f9-da9f8789ce62 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b86c016-5920-413a-a0b9-19e9ddcfa46e tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0dda5435-2b53-47d8-87f9-da9f8789ce62" status: 404 len: 109 microversion: 2.1 time: 0.074301 Sep 28 12:47:24.787229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 919/1805] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:47:24 2022] DELETE /compute/v2.1/os-volumes/0dda5435-2b53-47d8-87f9-da9f8789ce62 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:47:24.794286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8188de9-568c-4187-8cae-4af0aa604908 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Calling method '.version_select at 0x7f3062683a60>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:24.821530 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da702a0b-8a23-417a-9f16-b43aefcc3ae7 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.093392 Sep 28 12:47:24.822208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 887/1806] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:24 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:24.838393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-f8188de9-568c-4187-8cae-4af0aa604908 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] HTTP exception thrown: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8188de9-568c-4187-8cae-4af0aa604908 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Request method failure captured: Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/os-volumes/6aea4ec8-bb88-493f-baa3-2473d164d330 HTTP/1.1 Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEJcRpsQeESm0uZIAH3GIO4yVFFqgn_tJ8eB4uZTaSVBPRh0XR0M_jbJTZDOl5vZhFrhzlvi7mXLvSMJndJRB2ijM9n4MFNtSh56s3Qv3FaPeQoMPOvSTOaw62KT9DS58KLZYtWoA2buqgzf9LY5WPVTBL-a9xm_pz0257G83ywgB3w Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:47:24.840388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7709e0f0fe264af1a74065f0d38781fd", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7709e0f0fe264af1a74065f0d38781fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 7709e0f0fe264af1a74065f0d38781fd Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-VolumesNegativeTest-1370109551 Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 5cb3434ff57e4764b70129ad7902186d Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-VolumesNegativeTest-1370109551-project Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '6aea4ec8-bb88-493f-baa3-2473d164d330'} Sep 28 12:47:24.841744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. (HTTP 404) (Request-ID: req-ffcc42aa-0178-4244-8140-2e18b2f6a77c) Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.842574 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:47:24.843828 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:47:24.845289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f8188de9-568c-4187-8cae-4af0aa604908 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] Returning 404 to user: Volume 6aea4ec8-bb88-493f-baa3-2473d164d330 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:47:24.847222 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f8188de9-568c-4187-8cae-4af0aa604908 tempest-VolumesNegativeTest-1370109551 tempest-VolumesNegativeTest-1370109551-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6aea4ec8-bb88-493f-baa3-2473d164d330" status: 404 len: 109 microversion: 2.1 time: 0.051975 Sep 28 12:47:24.849308 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 920/1807] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:24 2022] GET /compute/v2.1/os-volumes/6aea4ec8-bb88-493f-baa3-2473d164d330 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:47:25.836563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c4076a15-d7a7-479a-abb6-f267b8d516f4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30634f7d30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:25.885526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c4076a15-d7a7-479a-abb6-f267b8d516f4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.053471 Sep 28 12:47:25.886179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 888/1808] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:25 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:26.900274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-370b9bca-963e-4ad7-8c87-091a501aafdb tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062683280>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:27.236809 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-370b9bca-963e-4ad7-8c87-091a501aafdb tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.340609 Sep 28 12:47:27.237531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 921/1809] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:26 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:28.248665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:28.249424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=4 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:28.253811 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaa8b7f5-f419-404b-8fc6-1e7fc0c9174f tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98ee0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:28.298717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaa8b7f5-f419-404b-8fc6-1e7fc0c9174f tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051322 Sep 28 12:47:28.299291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 889/1810] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:28 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:29.310778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:29.311564 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:47:29.316441 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6c859ec3-4534-4047-94b0-b06e73515ae9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062b4cdc0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:29.362746 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6c859ec3-4534-4047-94b0-b06e73515ae9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052585 Sep 28 12:47:29.363312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 922/1811] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:29 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:30.378113 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fb5139c7-b259-450b-bd6a-9960ec0a0d6e tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d57700>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:30.424251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fb5139c7-b259-450b-bd6a-9960ec0a0d6e tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050831 Sep 28 12:47:30.424863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 890/1812] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:30 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:31.439395 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8419fda2-90d5-4523-8688-236a4a054831 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065da5f70>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:31.484985 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8419fda2-90d5-4523-8688-236a4a054831 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049934 Sep 28 12:47:31.485916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 923/1813] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:31 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:47:32.499683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0a050a31-72a8-4262-b3c2-534e17cff3fb tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:32.545658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0a050a31-72a8-4262-b3c2-534e17cff3fb tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050233 Sep 28 12:47:32.546226 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 891/1814] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:32 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:33.560393 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7fc4942c-1e35-49e2-971a-81113a1e7b17 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626faa60>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:33.606379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7fc4942c-1e35-49e2-971a-81113a1e7b17 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050303 Sep 28 12:47:33.606931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 924/1815] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:33 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:34.621408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e2f6ce62-840b-4d50-af0b-2faf5a6e9a1e tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d61ca0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:34.666942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e2f6ce62-840b-4d50-af0b-2faf5a6e9a1e tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049761 Sep 28 12:47:34.667516 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 892/1816] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:34 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:35.682360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-04321769-4199-4b2a-a657-925c94cdd046 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062751ee0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:35.731942 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-04321769-4199-4b2a-a657-925c94cdd046 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.053784 Sep 28 12:47:35.732684 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 925/1817] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:35 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:36.747072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-040ec757-f169-4edd-8803-5d092c5b1a5a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062636ca0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:36.793168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-040ec757-f169-4edd-8803-5d092c5b1a5a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050379 Sep 28 12:47:36.793795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 893/1818] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:36 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:37.808531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c7fdfa0f-f2b9-43a6-a7a9-f2c2cb0a4455 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062683790>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:37.854303 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c7fdfa0f-f2b9-43a6-a7a9-f2c2cb0a4455 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050117 Sep 28 12:47:37.855010 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 926/1819] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:37 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:38.870153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e2a28eb-871f-46ee-afe1-859471574cb6 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30625a7b80>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:38.918751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e2a28eb-871f-46ee-afe1-859471574cb6 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.053065 Sep 28 12:47:38.919498 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 894/1820] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:38 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:39.934760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9e158026-05d4-4238-8fb2-391afc7361c4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065da5820>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:39.985043 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9e158026-05d4-4238-8fb2-391afc7361c4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.054588 Sep 28 12:47:39.985909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 927/1821] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:39 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:40.999326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce2ba5e8-204c-49ea-929a-e192ef2100a3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98790>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:41.046417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce2ba5e8-204c-49ea-929a-e192ef2100a3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051318 Sep 28 12:47:41.047049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 895/1822] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:40 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:42.061142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1767ba11-9a4f-481e-82ee-cf1bf84adb6b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306275c1f0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:42.108973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1767ba11-9a4f-481e-82ee-cf1bf84adb6b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051981 Sep 28 12:47:42.109556 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 928/1823] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:42 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:43.124494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b470b9c2-81e7-4f9f-bdf7-97d1954c3df4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc50d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:43.170306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b470b9c2-81e7-4f9f-bdf7-97d1954c3df4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050069 Sep 28 12:47:43.170855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 896/1824] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:43 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:44.185689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3d43fe80-203a-4106-a7d7-824cc10dc374 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30628309d0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:44.231516 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3d43fe80-203a-4106-a7d7-824cc10dc374 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050080 Sep 28 12:47:44.232083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 929/1825] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:44 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:45.246617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-93cab13c-e4d7-45aa-8cac-09bbff6c9f46 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98430>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:45.292176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-93cab13c-e4d7-45aa-8cac-09bbff6c9f46 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049732 Sep 28 12:47:45.292805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 897/1826] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:45 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:46.307388 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b324f47e-cc97-4002-9d65-b4e66c835c6c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626fa940>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:46.352625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b324f47e-cc97-4002-9d65-b4e66c835c6c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049575 Sep 28 12:47:46.353185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 930/1827] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:46 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:47.367526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-cd217705-ce70-4ad3-8ab5-fbe2e5ca0c1c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626361f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:47.412883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-cd217705-ce70-4ad3-8ab5-fbe2e5ca0c1c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049523 Sep 28 12:47:47.413446 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 898/1828] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:47 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:48.428373 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3c7f576c-b4e0-4237-b993-89cabf3fe45f tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306264a040>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:48.474063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3c7f576c-b4e0-4237-b993-89cabf3fe45f tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050663 Sep 28 12:47:48.474624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 931/1829] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:48 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:49.489406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-21ab59af-02bb-495d-9527-b038d0671a84 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062680af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:49.535568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-21ab59af-02bb-495d-9527-b038d0671a84 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050860 Sep 28 12:47:49.536136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 899/1830] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:49 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:50.550212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-de420763-7a6d-43b5-8c63-2a7068b81478 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062683430>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:50.595787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-de420763-7a6d-43b5-8c63-2a7068b81478 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049833 Sep 28 12:47:50.596372 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 932/1831] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:50 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:51.610737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b4e73138-ef4f-4eb1-ae83-e18a77c9940d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062636c10>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:51.655588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b4e73138-ef4f-4eb1-ae83-e18a77c9940d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049368 Sep 28 12:47:51.656153 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 900/1832] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:51 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:52.670890 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-82eb7a7f-52ab-42e7-84e3-c778c4d63c3a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065de4c10>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:52.718911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-82eb7a7f-52ab-42e7-84e3-c778c4d63c3a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052229 Sep 28 12:47:52.719470 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 933/1833] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:52 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:53.733992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9a3df747-0af2-44c6-b349-db5c4896d242 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d981f0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:53.779570 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9a3df747-0af2-44c6-b349-db5c4896d242 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049803 Sep 28 12:47:53.780137 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 901/1834] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:53 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:54.794913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-66a59b1e-0614-45fc-bd76-3c769f7d54db tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30627625e0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:54.840797 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-66a59b1e-0614-45fc-bd76-3c769f7d54db tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050065 Sep 28 12:47:54.841357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 934/1835] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:54 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:55.855566 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e3fe3ce9-950b-4269-b7c6-cec9f05be88a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d950d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:55.902838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e3fe3ce9-950b-4269-b7c6-cec9f05be88a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051492 Sep 28 12:47:55.903398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 902/1836] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:55 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:56.919518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a609ebcd-49e4-4164-9bed-6e80b0c275be tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065da5d30>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:56.965203 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a609ebcd-49e4-4164-9bed-6e80b0c275be tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049914 Sep 28 12:47:56.965853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 935/1837] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:56 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:57.981168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-af8dc4cc-c8ea-4c89-a605-6900678e7754 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98430>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:58.027016 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-af8dc4cc-c8ea-4c89-a605-6900678e7754 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050035 Sep 28 12:47:58.027590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 903/1838] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:57 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:47:59.042355 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cb881fb3-09aa-4e81-ad0f-2ae6674a315a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626faa60>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:47:59.092968 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cb881fb3-09aa-4e81-ad0f-2ae6674a315a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.054931 Sep 28 12:47:59.093537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 936/1839] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:47:59 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:00.107877 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6b9da9ea-4e7b-4286-9c39-567a656f49a3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5f70>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:00.153215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6b9da9ea-4e7b-4286-9c39-567a656f49a3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049760 Sep 28 12:48:00.153776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 904/1840] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:00 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:01.168054 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-737b883c-c9a0-45d0-8189-9abd6ef4e179 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626abe50>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:01.213663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-737b883c-c9a0-45d0-8189-9abd6ef4e179 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049927 Sep 28 12:48:01.214259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 937/1841] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:01 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:02.227901 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-71733394-a41c-41ed-bfa2-864117de327b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d95820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:02.277165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-71733394-a41c-41ed-bfa2-864117de327b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.053440 Sep 28 12:48:02.277734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 905/1842] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:02 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:03.291467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9aaf5d5e-635d-4f4f-af10-ab1ca595f05d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062830430>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:03.337318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9aaf5d5e-635d-4f4f-af10-ab1ca595f05d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050084 Sep 28 12:48:03.337876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 938/1843] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:03 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:04.351832 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-797c0cf1-189d-4dd4-8c8d-99946d2374ce tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306259f310>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:04.398838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-797c0cf1-189d-4dd4-8c8d-99946d2374ce tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051217 Sep 28 12:48:04.399966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 906/1844] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:04 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:05.414773 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7fb08f9b-1753-475f-a39e-8392b863ee3a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065de4b80>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:05.459961 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7fb08f9b-1753-475f-a39e-8392b863ee3a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049980 Sep 28 12:48:05.460557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 939/1845] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:05 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:06.475257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-14eeb9aa-a3cb-480e-8c45-06b7267c76d5 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc53a0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:06.521663 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-14eeb9aa-a3cb-480e-8c45-06b7267c76d5 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050703 Sep 28 12:48:06.522251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 907/1846] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:06 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:07.536520 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d933b034-8b7e-43e6-a8bb-b14786708d0c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626abca0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:07.581893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d933b034-8b7e-43e6-a8bb-b14786708d0c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049635 Sep 28 12:48:07.582448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 940/1847] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:07 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:08.597215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-961e1681-e6b5-47f5-9bdb-e43107d0ce8d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306271ec10>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:08.643427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-961e1681-e6b5-47f5-9bdb-e43107d0ce8d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050481 Sep 28 12:48:08.644041 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 908/1848] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:08 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:09.658330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-76f7c4a1-68ef-49c6-8777-44aefe0e4640 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065de4040>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:09.703200 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-76f7c4a1-68ef-49c6-8777-44aefe0e4640 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049168 Sep 28 12:48:09.703750 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 941/1849] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:09 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:10.718260 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-16e558e8-cc5d-48fb-9e93-9c02ecf90fc0 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5c10>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:10.764824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-16e558e8-cc5d-48fb-9e93-9c02ecf90fc0 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050848 Sep 28 12:48:10.765393 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 909/1850] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:10 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:11.779452 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-be2a4f11-b6ce-4f34-853e-82d6b00581b3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062683ca0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:11.825735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-be2a4f11-b6ce-4f34-853e-82d6b00581b3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050575 Sep 28 12:48:11.826294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 942/1851] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:11 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:12.840250 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-885bc4f8-2d10-4ce6-8991-ee9a620fd218 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306259faf0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:12.886165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-885bc4f8-2d10-4ce6-8991-ee9a620fd218 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050109 Sep 28 12:48:12.886718 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 910/1852] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:12 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:13.901869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-91915077-d55d-45e9-a111-86610ede3eba tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306257d430>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:13.947754 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-91915077-d55d-45e9-a111-86610ede3eba tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050167 Sep 28 12:48:13.948483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 943/1853] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:13 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:14.962463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e5a5377f-3497-4ac0-b04a-e1df7d0ba86b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d57700>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:15.010634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e5a5377f-3497-4ac0-b04a-e1df7d0ba86b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052382 Sep 28 12:48:15.011207 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 911/1854] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:14 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:16.025342 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0b3a2e1a-f8ce-4467-ac4f-31287c3b6aac tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062830dc0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:16.071905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0b3a2e1a-f8ce-4467-ac4f-31287c3b6aac tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050547 Sep 28 12:48:16.072896 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 944/1855] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:16 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:17.086979 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-927771c1-4474-49c1-ad2d-2db2ca1a1fc4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc80d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:17.237518 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-927771c1-4474-49c1-ad2d-2db2ca1a1fc4 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.154681 Sep 28 12:48:17.238179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 912/1856] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:17 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:18.253000 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-26cc8a06-2c6c-40d6-aa16-7a6cd1f717b5 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062762f70>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:18.344997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-26cc8a06-2c6c-40d6-aa16-7a6cd1f717b5 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.096216 Sep 28 12:48:18.345720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 945/1857] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:18 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:19.360203 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e6e86e54-efdf-4dd1-8d95-dd347306e571 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:19.408456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e6e86e54-efdf-4dd1-8d95-dd347306e571 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052425 Sep 28 12:48:19.409110 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 913/1858] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:19 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:20.422473 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b84bfd7b-34c4-4ccc-ae6f-5763252a9bdc tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306253e1f0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:20.468460 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b84bfd7b-34c4-4ccc-ae6f-5763252a9bdc tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050328 Sep 28 12:48:20.469026 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 946/1859] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:20 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:21.484370 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaf48562-de0c-4398-89dc-f3027223ed14 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065db1f70>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:21.532211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaf48562-de0c-4398-89dc-f3027223ed14 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052347 Sep 28 12:48:21.532815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 914/1860] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:21 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:22.547799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-30824026-f0e9-40ad-8a58-8734ed9b1b0b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065de4c10>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:22.593185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-30824026-f0e9-40ad-8a58-8734ed9b1b0b tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.049723 Sep 28 12:48:22.593745 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 947/1861] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:22 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:23.608224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-03bd8567-a064-41fa-868e-bc5bdfd70186 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5d30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:23.654962 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-03bd8567-a064-41fa-868e-bc5bdfd70186 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050952 Sep 28 12:48:23.655535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 915/1862] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:23 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:24.669951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c4a17bc9-eecb-496f-8264-2078470d6f45 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062683af0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:24.715642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c4a17bc9-eecb-496f-8264-2078470d6f45 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050053 Sep 28 12:48:24.716337 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 948/1863] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:24 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:48:25.730554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2580ab1d-a708-4bc8-90ea-475e23181196 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062680af0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:25.776568 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2580ab1d-a708-4bc8-90ea-475e23181196 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050272 Sep 28 12:48:25.777131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 916/1864] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:25 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:26.791804 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5e0058db-5d13-4f48-8db1-a0f4790aa132 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306253edc0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:26.838117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5e0058db-5d13-4f48-8db1-a0f4790aa132 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050468 Sep 28 12:48:26.838698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 949/1865] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:26 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:27.853500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d80266e0-b7e3-4c46-81bc-b1f0a2c415a9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d93f70>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:27.901646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d80266e0-b7e3-4c46-81bc-b1f0a2c415a9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052954 Sep 28 12:48:27.908354 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 917/1866] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:27 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:28.916152 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dfe5c5c1-3ca4-4226-adbc-e3c3ffe44352 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065da5310>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:28.962415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dfe5c5c1-3ca4-4226-adbc-e3c3ffe44352 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051072 Sep 28 12:48:28.962981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 950/1867] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:28 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:29.977149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b9009b83-6466-480e-806e-eaf19e0e5f6a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc80d0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:30.023626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b9009b83-6466-480e-806e-eaf19e0e5f6a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050747 Sep 28 12:48:30.024219 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 918/1868] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:29 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:31.039204 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d425079e-6f10-48b0-824a-177f9cb16d73 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3062762f70>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:31.085912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d425079e-6f10-48b0-824a-177f9cb16d73 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051049 Sep 28 12:48:31.086685 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 951/1869] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:31 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:32.101464 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-970a380b-65d8-431a-982a-2324e4bc676d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5280>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:32.147213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-970a380b-65d8-431a-982a-2324e4bc676d tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050816 Sep 28 12:48:32.147781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 919/1870] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:32 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:33.161718 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-02c97737-fd0b-4eb4-8920-60b1585c7fa3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306252a9d0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:33.208119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-02c97737-fd0b-4eb4-8920-60b1585c7fa3 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.051410 Sep 28 12:48:33.208729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 952/1871] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:33 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:34.224556 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-902a2618-d952-4c9f-af95-b10adf72a271 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98ca0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:34.284693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-902a2618-d952-4c9f-af95-b10adf72a271 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.065849 Sep 28 12:48:34.285258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 920/1872] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:34 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:35.299368 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1ebf1bd5-5ea6-4b43-8686-62bacfe07e1c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306253edc0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:35.347479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1ebf1bd5-5ea6-4b43-8686-62bacfe07e1c tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052316 Sep 28 12:48:35.348370 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 953/1873] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:35 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:36.363681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4da8f6d9-ad1d-43bc-be3c-10530166f89a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc5940>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:36.410687 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4da8f6d9-ad1d-43bc-be3c-10530166f89a tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 353 microversion: 2.1 time: 0.051569 Sep 28 12:48:36.411305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 921/1874] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:36 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:36.423888 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9b64430b-563d-4e01-8e58-06c9292dc4c7 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306257d700>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:36.470835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9b64430b-563d-4e01-8e58-06c9292dc4c7 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 353 microversion: 2.1 time: 0.050526 Sep 28 12:48:36.471764 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 954/1875] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:36 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:36.492743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-08729302-f0d6-4265-8cbb-30c602a32ce9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065dc8e50>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:36.562059 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-08729302-f0d6-4265-8cbb-30c602a32ce9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 202 len: 0 microversion: 2.1 time: 0.073457 Sep 28 12:48:36.562629 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 922/1876] 10.222.0.26 () {58 vars in 1248 bytes} [Wed Sep 28 12:48:36 2022] DELETE /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:48:36.571170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2e36b5ea-5789-4423-9572-67ad91d70aaa tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626fa940>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:36.621934 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2e36b5ea-5789-4423-9572-67ad91d70aaa tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.055129 Sep 28 12:48:36.622532 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 955/1877] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:36 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:37.635804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d9c97831-625a-4435-8cda-cbf704f706a9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d988b0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:37.681931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d9c97831-625a-4435-8cda-cbf704f706a9 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.050274 Sep 28 12:48:37.682482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 923/1878] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:37 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:38.696724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d1fbbf72-0a4e-45d4-baf9-e1a93380fd87 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f306253eb80>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:38.744412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d1fbbf72-0a4e-45d4-baf9-e1a93380fd87 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.052211 Sep 28 12:48:38.744956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 956/1879] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:38 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:39.759472 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-fe4ba9b7-21fa-49e4-91f0-6fa5743999ef tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626363a0>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:39.808067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-fe4ba9b7-21fa-49e4-91f0-6fa5743999ef tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.053345 Sep 28 12:48:39.808679 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 924/1880] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:39 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:48:40.822868 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f0008f7a-d12d-4d22-bd45-f9f2fe804418 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f30626abdc0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:40.878247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f0008f7a-d12d-4d22-bd45-f9f2fe804418 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 200 len: 352 microversion: 2.1 time: 0.059505 Sep 28 12:48:40.878822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 957/1881] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:40 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:48:41.893420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52e514de-d180-4224-b05c-ec8f08df6991 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Calling method '.version_select at 0x7f3065d98160>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:48:41.922070 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-52e514de-d180-4224-b05c-ec8f08df6991 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] HTTP exception thrown: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52e514de-d180-4224-b05c-ec8f08df6991 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Request method failure captured: Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 HTTP/1.1 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNEJcdMZT1QDs1vxKt43d1G0BULNfOUAWg5Zcvvq0F4LqNm8iPiym4TlYgANWXx11WzMu2dyp0N04gkFIIBMQyU4RJ5V9653862Sgr_X6T8DRINmZcEPB-jaIFt8cFDncU7YHw5V7r7_-mNxZrZQwXElg6YWwOkhxvCNyKDJlorRc-hg Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 557063c52e344d5383e2ceabda9bcac7 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-VolumesGetTestJSON-235254315 Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:48:41.924197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/557063c52e344d5383e2ceabda9bcac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_557063c52e344d5383e2ceabda9bcac7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/557063c52e344d5383e2ceabda9bcac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/557063c52e344d5383e2ceabda9bcac7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-VolumesGetTestJSON-235254315 Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 557063c52e344d5383e2ceabda9bcac7 Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-VolumesGetTestJSON-235254315 Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-VolumesGetTestJSON-235254315-project Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 9ef1cdec1a5a4c4ea1de2308d0f8de31 Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-VolumesGetTestJSON-235254315-project Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '3e51c726-9de6-4a55-a30d-f6aab1f6b776'} Sep 28 12:48:41.925697 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. (HTTP 404) (Request-ID: req-c6ff29b9-0241-43e4-903b-b5dce23b8217) Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:48:41.930300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 12:48:41.931588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 12:48:41.932961 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-52e514de-d180-4224-b05c-ec8f08df6991 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] Returning 404 to user: Volume 3e51c726-9de6-4a55-a30d-f6aab1f6b776 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-52e514de-d180-4224-b05c-ec8f08df6991 tempest-VolumesGetTestJSON-235254315 tempest-VolumesGetTestJSON-235254315-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776" status: 404 len: 109 microversion: 2.1 time: 0.036670 Sep 28 12:48:41.934199 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 925/1882] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:48:41 2022] GET /compute/v2.1/os-volumes/3e51c726-9de6-4a55-a30d-f6aab1f6b776 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:14.331634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4f00aba6-1fc8-4692-8015-f8f3bc986eda tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Action: 'create', calling method: .version_select at 0x7f3065da5700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1600759875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSxeE9vldNNjZLSXpKP364yE3NbvXtjkoLJjojVwtciKG3dpYhpdCM0JT1g1OnagDj3B85VVbv6ox7gp1q1AsrqBpPv6fLreM61h8tdsscS9mzg15MyCnOiIw7wXRnPwA=="}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:49:14.354784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-4f00aba6-1fc8-4692-8015-f8f3bc986eda tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Getting quotas for project 325a146c46e54eec898106e7b88a86b6. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:49:14.359739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-4f00aba6-1fc8-4692-8015-f8f3bc986eda tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Getting quotas for user b287a26201c142f983d844c07df169e9 and project 325a146c46e54eec898106e7b88a86b6. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:49:14.408602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4f00aba6-1fc8-4692-8015-f8f3bc986eda tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.300878 Sep 28 12:49:14.409720 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 958/1883] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:49:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:21.678681 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:21.679188 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:21.685672 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:21.686151 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:21.686590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:21.687277 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:21.687728 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:21.688154 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:21.702519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf HTTP/1.1 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:49:21.704193 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.705675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '53829cee-0c58-44b4-84d2-4f47a4167cdf'} Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:21.706366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.708588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.710120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:21.710120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-79bd17c5-9175-454f-9af5-6a751d39469f tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 404 len: 111 microversion: 2.1 time: 0.032446 Sep 28 12:49:21.710120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 926/1884] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:49:21 2022] DELETE /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:21.717052 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:21.717919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 53829cee-0c58-44b4-84d2-4f47a4167cdf] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:21.725146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:21.725621 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:21.726051 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:21.726742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:21.727189 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:21.727606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:21.744428 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf HTTP/1.1 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:49:21.745982 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.747628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '53829cee-0c58-44b4-84d2-4f47a4167cdf'} Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:21.748483 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. Sep 28 12:49:21.749606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:21.750799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 53829cee-0c58-44b4-84d2-4f47a4167cdf could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:21.750799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-44ec3cc7-62ae-4048-a971-12253e68a6fc tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf" status: 404 len: 111 microversion: 2.1 time: 0.035939 Sep 28 12:49:21.750799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 959/1885] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:49:21 2022] GET /compute/v2.1/servers/53829cee-0c58-44b4-84d2-4f47a4167cdf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:22.903545 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:22.904249 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:22.911906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:22.912361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:22.912800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:22.914944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:22.915409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:22.915835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:22.931564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d HTTP/1.1 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:49:22.933398 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.934922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '97720b27-58c6-4839-af0c-7c669c4b841d'} Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:22.935723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.937072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.938420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:22.938420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0fca7b86-ff9d-4728-abaf-5fcba333329b tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 404 len: 111 microversion: 2.1 time: 0.035309 Sep 28 12:49:22.938420 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 927/1886] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:49:22 2022] DELETE /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:22.947589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:22.948859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 97720b27-58c6-4839-af0c-7c669c4b841d] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:22.956267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:22.957294 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:22.957733 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:22.958453 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:22.958909 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:22.959340 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:22.974913 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d HTTP/1.1 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:49:22.976527 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.977943 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '97720b27-58c6-4839-af0c-7c669c4b841d'} Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:22.978712 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. Sep 28 12:49:22.979817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:22.980864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 97720b27-58c6-4839-af0c-7c669c4b841d could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:22.980864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a514f053-4017-42fb-a3cf-5a9b5f956f7d tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d" status: 404 len: 111 microversion: 2.1 time: 0.034470 Sep 28 12:49:22.980864 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 960/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:49:22 2022] GET /compute/v2.1/servers/97720b27-58c6-4839-af0c-7c669c4b841d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:24.118012 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:24.118504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:24.124905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:24.125375 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:24.125803 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:24.126500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:24.126942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:24.127360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:24.141039 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: DELETE /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 HTTP/1.1 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:49:24.142504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.143907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9'} Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:24.144661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.145870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.147150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:24.147150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2756031c-40bb-489e-b389-53f2c52162f2 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 404 len: 111 microversion: 2.1 time: 0.029637 Sep 28 12:49:24.147150 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 928/1888] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:49:24 2022] DELETE /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:24.152885 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:24.153493 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] [instance: 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:49:24.160427 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:24.160902 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:24.161335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:24.162020 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:49:24.162462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:49:24.162879 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:49:24.176651 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] HTTP exception thrown: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Request method failure captured: Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 HTTP/1.1 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNDrBNTDuXdVzp-f_SkUGDNnQzVvW-TJWrp98tRVlSz_sZa2Y36IpUqrkBCEpwKSirB3N6TB4LfBGUXfXMRJUe0xFiEFIblpuawBiVJPYnfiZ0_QBLo8oj9itpcZzAr5k1uYbF24mw4CRKkl8lY5e3JLvAHXRpOc_5CABSF5IZ664W5A Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:49:24.178142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81f514e581a3473188c0ca78416919a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81f514e581a3473188c0ca78416919a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81f514e581a3473188c0ca78416919a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 81f514e581a3473188c0ca78416919a4 Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-633589982 Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 4a8818fd59954480bcff68b9ba52769a Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-AttachVolumeNegativeTest-633589982-project Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.179627 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9'} Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:49:24.180457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. Sep 28 12:49:24.181796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:49:24.183001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] Returning 404 to user: Instance 55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:49:24.183001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-56c786bc-ad8d-490a-9cbc-4c9a01d14fb7 tempest-AttachVolumeNegativeTest-633589982 tempest-AttachVolumeNegativeTest-633589982-project] 10.222.0.26 "GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9" status: 404 len: 111 microversion: 2.1 time: 0.030515 Sep 28 12:49:24.183001 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 961/1889] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:49:24 2022] GET /compute/v2.1/servers/55c1c9c1-ebf8-4a42-9f5e-8159b9298ba9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:49:31.052400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-17395bc3-7705-425c-a053-a51f289e4031 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3065d95670>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:31.100025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-17395bc3-7705-425c-a053-a51f289e4031 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/60fae05f-f43d-4f63-b655-b16442a3cfae" status: 200 len: 350 microversion: 2.1 time: 0.051363 Sep 28 12:49:31.100628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 929/1890] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:49:31 2022] GET /compute/v2.1/os-volumes/60fae05f-f43d-4f63-b655-b16442a3cfae => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:35.627093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f0801c63-3791-4d75-bb71-328e25796bfe tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f306264a820>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:35.633565 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:49:35.634383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:49:35.634991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=6 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:49:35.678905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f0801c63-3791-4d75-bb71-328e25796bfe tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ec30b49c-e572-4117-93c6-2338191dfa11" status: 200 len: 351 microversion: 2.1 time: 0.055480 Sep 28 12:49:35.679507 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 962/1891] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:49:35 2022] GET /compute/v2.1/os-volumes/ec30b49c-e572-4117-93c6-2338191dfa11 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.042186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:49:37.042932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:49:37.047345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-beed36a1-b721-48e1-bda7-61d919ba84a1 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3065e0b820>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.095109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-beed36a1-b721-48e1-bda7-61d919ba84a1 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8604f8cf-c7a5-4014-b39e-873f7f96896f" status: 200 len: 350 microversion: 2.1 time: 0.053345 Sep 28 12:49:37.095109 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 930/1892] 10.222.0.26 () {58 vars in 1245 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes/8604f8cf-c7a5-4014-b39e-873f7f96896f => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.108259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c9fe48cd-5ec2-4ef2-be7c-5f7c7d64101e tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f306253e160>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.202626 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c9fe48cd-5ec2-4ef2-be7c-5f7c7d64101e tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098550 Sep 28 12:49:37.203193 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 963/1893] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:49:37.217060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5082387-a7dc-44d4-9148-6839206c69f6 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3065d95700>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.296969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5082387-a7dc-44d4-9148-6839206c69f6 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083714 Sep 28 12:49:37.297555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 931/1894] 10.222.0.26 () {58 vars in 1149 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.311645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ac1cbb15-62f9-4d32-ac8e-cabde5766146 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3063c6ee50>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.391929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ac1cbb15-62f9-4d32-ac8e-cabde5766146 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083963 Sep 28 12:49:37.392544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 964/1895] 10.222.0.26 () {58 vars in 1134 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:49:37.405471 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aedc3ae6-67da-4a4d-9fad-977db6f16340 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3065e0bc10>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.497132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aedc3ae6-67da-4a4d-9fad-977db6f16340 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095276 Sep 28 12:49:37.497702 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 932/1896] 10.222.0.26 () {58 vars in 1167 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.511930 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1d83a8b0-7721-4f47-9e99-268853f9d308 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f30629d1790>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.593912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1d83a8b0-7721-4f47-9e99-268853f9d308 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085277 Sep 28 12:49:37.594543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 965/1897] 10.222.0.26 () {58 vars in 1170 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.609186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0342b4c8-2f38-4627-ab48-88b24be7369c tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f3065dacd30>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.693597 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0342b4c8-2f38-4627-ab48-88b24be7369c tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088086 Sep 28 12:49:37.694278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 933/1898] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:49:37.707560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a001f0ee-01a3-4cb9-8794-d13b20edd66d tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f306269ab80>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.793284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a001f0ee-01a3-4cb9-8794-d13b20edd66d tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089354 Sep 28 12:49:37.793858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 966/1899] 10.222.0.26 () {58 vars in 1188 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:49:37.808397 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6e357020-5e0f-4c8a-885e-8e8252c52f04 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] Calling method '.version_select at 0x7f306285e310>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:49:37.891921 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6e357020-5e0f-4c8a-885e-8e8252c52f04 tempest-VolumesTestJSON-699870649 tempest-VolumesTestJSON-699870649-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087700 Sep 28 12:49:37.892579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 934/1900] 10.222.0.26 () {58 vars in 1155 bytes} [Wed Sep 28 12:49:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:49:59.392642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1749877963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1600759875", "security_groups": [{"name": "tempest-secgroup-smoke-958424951"}], "networks": [{"uuid": "674671ed-bcf8-47c4-a5e9-6bdcf46123b8"}], "block_device_mapping_v2": [{"uuid": "95bf4f49-7c98-409a-a5ab-8220c234dd84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:49:59.623552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.network.neutron [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] validate_networks() for [('674671ed-bcf8-47c4-a5e9-6bdcf46123b8', None, None, None, None, None)] {{(pid=120636) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:50:00.576649 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Flavor limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:50:00.577303 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Image limits 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:50:00.577916 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Flavor pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:50:00.578422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Image pref 0:0:0 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:50:00.578931 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.virt.hardware [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120636) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:50:00.596464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:00.598852 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:00.599352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:00.600215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:00.601941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:00.602479 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:00.645743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Getting quotas for project 325a146c46e54eec898106e7b88a86b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:50:00.659394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Getting quotas for user b287a26201c142f983d844c07df169e9 and project 325a146c46e54eec898106e7b88a86b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:50:00.773892 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Going to run 1 instances... {{(pid=120636) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:50:00.776124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95bf4f49-7c98-409a-a5ab-8220c234dd84',volume_size=None,volume_type=None)] {{(pid=120636) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:50:01.036269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-81fbf3e3-7117-4f33-9f56-1593f6a9dde9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.649221 Sep 28 12:50:01.039860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 967/1901] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:49:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:50:01.053306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-20a4444a-ec2f-42bb-910f-a8eb675ad601 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:01.055620 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-20a4444a-ec2f-42bb-910f-a8eb675ad601 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:01.301313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-20a4444a-ec2f-42bb-910f-a8eb675ad601 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:01.310488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-20a4444a-ec2f-42bb-910f-a8eb675ad601 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1089 microversion: 2.1 time: 0.263335 Sep 28 12:50:01.311892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 935/1902] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:01 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1089 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:02.334576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:02.336035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:02.348420 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:02.349326 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:02.352665 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:02.353679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:02.354353 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:02.355005 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:03.200426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:03.208518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9a18ea08-448e-4a0c-9a2f-0425fcb14b66 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1187 microversion: 2.1 time: 0.878347 Sep 28 12:50:03.214638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 968/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:02 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1187 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:04.244563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:04.245951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:04.261342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:04.263965 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:04.266607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:04.268771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:04.272567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:04.273703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:04.611732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:04.628396 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-247f19f6-9d36-4310-b6d3-d08d4fda1957 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.388557 Sep 28 12:50:04.630300 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 936/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:04 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:05.536895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:05.547609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-39d5bac1-fc01-4360-af41-7edde8e6cdb4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Action: 'create', calling method: .version_select at 0x7f3065df8670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-136676255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/pyu/gYkM5/YtIw2Xgicju+6s1d2KejONhPcxcRX2zdEQXuoPTVqOqzRbFXzDPCIbxmO2ZO028mM7OD94Qi5V9E/T6wk56XtBrZsVmJTmvoxQi1hL6o6EKUYD68Dwu+w=="}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:05.556535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:05.557707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:05.558632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:05.564111 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-39d5bac1-fc01-4360-af41-7edde8e6cdb4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:50:05.568354 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.quota [None req-39d5bac1-fc01-4360-af41-7edde8e6cdb4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for user 4d70d61439324d4b9c3b3513799b896c and project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'key_pairs'} {{(pid=120636) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:50:05.574033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] Creating event network-changed:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:50:05.581547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b11f661e-cc83-4b2a-a97c-8a698ad26068 req-93f33ad2-95f1-4f5f-8112-1eda50e30560 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251149 Sep 28 12:50:05.582721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 937/1905] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:05.611673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-39d5bac1-fc01-4360-af41-7edde8e6cdb4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.310050 Sep 28 12:50:05.614041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 969/1906] 10.222.0.26 () {60 vars in 1159 bytes} [Wed Sep 28 12:50:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:05.656975 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:05.657833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:05.666149 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:05.666636 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:05.667120 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:05.667792 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:05.668246 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:05.668892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:06.013675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:06.029804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-89a888c0-9ce3-4769-b70b-61ed16a1043a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.381025 Sep 28 12:50:06.037384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 938/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:05 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:07.054859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:07.057011 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:07.074184 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:07.074951 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:07.076088 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:07.077002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:07.078104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:07.078698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:07.298437 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:07.328726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8400134e-5629-4bec-b172-a0db4673af8b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.272651 Sep 28 12:50:07.328726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 970/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:07 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:08.347661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:08.348772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:08.372384 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:08.374802 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:08.375539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:08.376667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:08.384289 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:08.385144 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:08.547478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:08.556086 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-acab102a-2819-4f0c-a09c-89ba63e5455a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.213418 Sep 28 12:50:08.568789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 939/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:08 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:09.582461 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:09.583935 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:09.591119 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:09.591613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:09.592060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:09.592794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:09.593249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:09.593677 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:09.747597 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:09.756404 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bb51a00b-6d0b-43fa-b2e3-3d72e14da698 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.181022 Sep 28 12:50:09.757799 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 971/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:09 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:50:10.784916 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:10.785526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:10.791580 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:10.792076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:10.792521 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:10.793210 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:10.793655 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:10.794072 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:10.997360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:11.005467 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce26e61c-e86a-4c80-a878-0643cb022930 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.229397 Sep 28 12:50:11.006212 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 940/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:10 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:12.029812 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:12.030458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:12.035786 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:12.037794 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:12.038286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:12.038707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:12.039387 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:12.039830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:12.040249 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:12.187640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:12.196045 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3b748e30-d200-4a52-b5fa-e43f4a2410da tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.170118 Sep 28 12:50:12.196636 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 972/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:12 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:13.218907 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:13.219515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:13.221772 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:13.228003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:13.228510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:13.228941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:13.229631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:13.230082 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:13.230500 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:13.373097 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:13.380788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4f4735ac-a41c-451e-ae6c-97eddc84f22b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.165644 Sep 28 12:50:13.381350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 941/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:13 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:14.406414 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:14.407438 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:14.414341 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:14.414816 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:14.415247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:14.415937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:14.416408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:14.416853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:14.557447 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:14.565185 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d2ff8e59-275f-4a96-9a2e-962f710c3c81 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.162673 Sep 28 12:50:14.565751 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 973/1914] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:14 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:15.588856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:15.589505 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:15.596062 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:15.596673 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:15.597182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:15.597988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:15.598517 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:15.599011 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:15.736201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:15.744182 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-1f3a410f-79aa-4999-b7b4-c0a3ab577638 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.159209 Sep 28 12:50:15.744790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 942/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:15 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:16.767569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:16.768108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:16.770533 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=10 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:16.776912 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:16.777396 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:16.777833 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:16.778529 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:16.779103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:16.779551 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:16.915893 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:16.923570 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9f0be756-2b87-4415-b932-009ca9530803 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.160095 Sep 28 12:50:16.924365 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 974/1916] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:16 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:17.184044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "name": "network-vif-plugged", "status": "completed", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:17.194028 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:17.195122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:17.195561 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:17.207683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] Creating event network-vif-plugged:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:50:17.213049 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-b7dcd2d1-691d-4d5d-93fd-90705178adb1 req-9e0b3d58-c570-46bd-8863-99b909ea21ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169290 Sep 28 12:50:17.213942 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 943/1917] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:17.948459 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:17.949122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:17.956061 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:17.956607 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:17.957071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:17.957822 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:17.958316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:17.958766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:18.092900 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:18.101310 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-86700d8a-5a55-4699-81fc-dc27b8f96efa tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.156431 Sep 28 12:50:18.101881 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 975/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:17 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:19.126351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:19.127054 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:19.133319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:19.133976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:19.134419 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:19.135296 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:19.135753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:19.136430 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:19.278131 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:19.286428 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d046b4db-00c6-4bcb-9ff2-f6bcc5c7c312 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1260 microversion: 2.1 time: 0.164661 Sep 28 12:50:19.287063 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 944/1919] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:19 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:20.311589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:20.311589 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:20.317973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:20.318444 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:20.318873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:20.319557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:20.320003 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:20.320449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:20.458108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:20.465734 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-11f3fd57-4967-4174-ac3e-e41ac00884d2 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1445 microversion: 2.1 time: 0.158656 Sep 28 12:50:20.466300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 976/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:20 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:20.496284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:20.496960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:20.503385 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:20.503863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:20.504294 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:20.505035 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:20.505485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:20.505908 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:20.641554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:20.649542 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4576ab2c-14c4-437f-ba5d-3b7cab2850bd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1445 microversion: 2.1 time: 0.165239 Sep 28 12:50:20.650104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 945/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:20 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:22.619309 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:22.629269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:22.629737 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:22.630158 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:22.641748 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] Creating event network-changed:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:50:22.645118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] [88dbc832-9826-4fb6-8557-a6ec2e07c855] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:50:23.654262 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] [88dbc832-9826-4fb6-8557-a6ec2e07c855] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56886. Sep 28 12:50:23.658711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-bc5cb71c-1324-4eba-b939-c48673050ca8 req-051bbcd7-8044-4703-811d-d7abea9b1330 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043363 Sep 28 12:50:23.659331 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 977/1922] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:37.080781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-463124275", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-136676255", "security_groups": [{"name": "tempest-secgroup-smoke-1087525056"}], "block_device_mapping_v2": [{"uuid": "2e1713ca-d90d-4a9c-81bf-e04020744973", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e691ab45-7c50-4cf7-b5bb-d7dde8084b2c"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:37.091966 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=24 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:37.092771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=52 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:37.204406 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] validate_networks() for [('e691ab45-7c50-4cf7-b5bb-d7dde8084b2c', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:50:37.627707 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:50:37.628152 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:50:37.628677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:50:37.629084 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:50:37.629490 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:50:37.638751 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:37.639165 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:37.639592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:37.640330 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:37.640784 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:37.641204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:37.658271 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:50:37.662175 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for user 4d70d61439324d4b9c3b3513799b896c and project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:50:37.717167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:50:37.719336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e1713ca-d90d-4a9c-81bf-e04020744973',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:50:37.845098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [07d58d23-aad9-4a43-9b1a-81f3fd363a82] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:50:38.852981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [07d58d23-aad9-4a43-9b1a-81f3fd363a82] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56984. Sep 28 12:50:38.858235 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7e6a75e1-62f5-465e-928e-7854e144c053 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.781305 Sep 28 12:50:38.863429 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 946/1923] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:50:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:50:38.869287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:38.870232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=52 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:38.874247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4153336a-ac86-4d4b-96ba-049efb373cc9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:38.874948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4153336a-ac86-4d4b-96ba-049efb373cc9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:38.935633 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4153336a-ac86-4d4b-96ba-049efb373cc9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:38.942630 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4153336a-ac86-4d4b-96ba-049efb373cc9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1093 microversion: 2.1 time: 0.074975 Sep 28 12:50:38.943201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 978/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:38 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:39.966940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:39.967550 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:39.973735 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:39.974215 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:39.974649 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:39.975339 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:39.975793 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:39.976738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:40.040851 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:40.048391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-7c54da2c-76fa-4eec-9e06-8fd3c304a8e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1143 microversion: 2.1 time: 0.085730 Sep 28 12:50:40.048953 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 947/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:39 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:41.071825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:41.072457 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:41.079729 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:41.080205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:41.080669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:41.081349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:41.081795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:41.082213 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:41.140476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:41.148064 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e945f0ac-cda6-4015-9116-0be5ba0f699e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1135 microversion: 2.1 time: 0.080983 Sep 28 12:50:41.148679 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 979/1926] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:41 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1135 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:42.171534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:42.172050 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:42.180285 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:42.180796 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:42.181227 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:42.181957 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:42.182579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:42.183003 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:42.274526 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:42.284094 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d56a4051-03c9-4da8-a787-88340bbae107 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1199 microversion: 2.1 time: 0.116508 Sep 28 12:50:42.284912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 948/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:42 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:43.308803 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:43.309538 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:43.315827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:43.316296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:43.316752 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:43.317437 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:43.318099 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:43.318282 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:43.454394 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:43.463766 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-56abd9be-3ca9-4df0-8bbb-969043bedde7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.158741 Sep 28 12:50:43.464377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 980/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:43 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:43.632940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ec2325-e36b-4f3f-9fb6-6114edf484c7", "tag": "a59dc084-4259-4942-8f31-989db629685e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:43.644301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:43.644874 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:43.645164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:43.658136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] Creating event network-changed:a59dc084-4259-4942-8f31-989db629685e for instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 on hv-cinder-85919 Sep 28 12:50:43.663181 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c873ff22-eac5-4df7-9aef-0d90eb6a8a79 req-ddec82a4-7bf3-48b1-96eb-11cd415bc5c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Sep 28 12:50:43.663947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 949/1929] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:44.486781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:44.487389 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:44.494207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:44.494682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:44.495467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:44.495787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:44.496235 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:44.496694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:44.625971 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:44.634181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-74b70180-b024-4448-90b3-77cbe659924e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.151357 Sep 28 12:50:44.634747 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 981/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:44 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:45.656974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:45.657675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:45.663886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:45.664394 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:45.664830 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:45.665534 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:45.665970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:45.666427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:45.794192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:45.801778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3bb894b2-fe46-4c0f-98dc-2ede38292b79 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.149538 Sep 28 12:50:45.802336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 950/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:45 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:46.825963 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:46.826599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:46.833619 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:46.834106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:46.834544 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:46.835876 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:46.836349 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:46.836781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:46.982443 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:46.990949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-86461c9a-e1ca-4c84-9619-00c140db26e8 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.169616 Sep 28 12:50:46.992361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 982/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:46 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:48.014361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:48.014969 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:48.017458 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:48.018311 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:48.024107 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:48.024645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:48.025080 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:48.025777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:48.026239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:48.026665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:48.158725 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:48.167075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ce35c087-0c9f-4410-9690-beb4544848fd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.156633 Sep 28 12:50:48.167682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 951/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:48 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:49.190187 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:49.190798 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:49.193177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:50:49.199205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:49.199682 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:49.200118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:49.200839 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:49.201290 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:49.201716 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:49.328832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:49.336523 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-4ed1dbc9-7b46-4771-be6a-2b865efc16eb tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.150263 Sep 28 12:50:49.337092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 983/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:49 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:50.360014 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:50.360777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:50.368947 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:50.369624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:50.370281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:50.371357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:50.372112 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:50.372746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:50.514838 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:50.522758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-b98f51f6-1a52-4d66-baae-1c3553bd4ee6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.167693 Sep 28 12:50:50.523320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 952/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:50 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:51.545541 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:51.546147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:51.552553 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:51.553025 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:51.553451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:51.554129 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:51.554580 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:51.554997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:51.684431 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:51.692261 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c46d99c4-7003-44b2-9253-8ff251dc0138 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.150602 Sep 28 12:50:51.692858 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 984/1936] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:51 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:52.717321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:52.717849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:52.724321 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:52.724815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:52.725251 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:52.725944 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:52.726402 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:52.726833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:52.861239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:52.869720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-07dea403-1c83-4e9d-8b1a-b822c75cfc76 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.156369 Sep 28 12:50:52.870282 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 953/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:52 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:53.256383 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ec2325-e36b-4f3f-9fb6-6114edf484c7", "name": "network-vif-plugged", "status": "completed", "tag": "a59dc084-4259-4942-8f31-989db629685e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:53.266784 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:53.267264 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:53.267692 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:53.281139 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] Creating event network-vif-plugged:a59dc084-4259-4942-8f31-989db629685e for instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 on hv-cinder-85919 Sep 28 12:50:53.286519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-ef0f7b35-c4cc-4a9a-87f9-2ed5cee9ae10 req-853ab874-3852-4227-b7eb-9aff809d005f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040077 Sep 28 12:50:53.287284 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 985/1938] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:50:53.891946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:53.892795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:53.899805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:53.900283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:53.900739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:53.901427 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:53.901885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:53.902308 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:54.029455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:54.037185 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-205b8650-70d1-4ddf-b779-3ebe74eb524e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.149137 Sep 28 12:50:54.037744 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 954/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:53 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:55.061253 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:55.061949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:55.068862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:55.069826 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:55.070260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:55.070948 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:55.071392 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:55.071811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:55.250825 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:55.261555 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-459e0cd7-8825-44b1-9ad7-09bb8c375b23 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1265 microversion: 2.1 time: 0.204597 Sep 28 12:50:55.262640 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 986/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:55 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:50:56.284615 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:56.285232 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:56.291771 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:56.292255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:56.292721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:56.293712 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:56.294171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:56.294599 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:56.444168 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:56.452482 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-01363319-64c7-40c9-ae28-19338d4d0971 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1452 microversion: 2.1 time: 0.171686 Sep 28 12:50:56.453051 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 955/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:56 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:56.474762 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:50:56.475362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:50:56.481795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:56.482276 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:56.482704 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:56.483400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:56.483842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:56.484259 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:56.617949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:50:56.626153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c80b2a01-8e10-4640-8d89-8c1c4e3a665b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1452 microversion: 2.1 time: 0.155169 Sep 28 12:50:56.626724 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 987/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:50:56 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:50:58.781630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ec2325-e36b-4f3f-9fb6-6114edf484c7", "tag": "a59dc084-4259-4942-8f31-989db629685e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:50:58.792504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:50:58.792981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:50:58.793408 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:50:58.805485 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] Creating event network-changed:a59dc084-4259-4942-8f31-989db629685e for instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 on hv-cinder-85919 Sep 28 12:50:58.811044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-89e0febe-8898-4bd1-b6fa-f11204bbf770 req-ac0bc880-92de-4705-8d03-31c0a3af22d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163084 Sep 28 12:50:58.811998 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 956/1943] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:52:49.304995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:52:49.305815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=22 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:52:49.306566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=50 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:52:49.307371 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:52:49.307522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action (ip 10.222.0.26) !!! Sep 28 12:52:49.308602 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:52:49.308711 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action (ip 10.222.0.26) !!! Sep 28 12:52:49.315467 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:52:49.315992 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:49.326531 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:49.327242 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:49.327753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:49.328688 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:49.329223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:49.329645 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:49.354167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lazy-loading 'flavor' on Instance uuid d92864b0-c53b-4ab9-85ec-b308e7a81c7c {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:52:49.424843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-6894a52f-dfb3-4586-ab09-0442dd228ed1 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "POST /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action" status: 202 len: 0 microversion: 2.1 time: 0.121439 Sep 28 12:52:49.425422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 988/1944] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:52:49 2022] POST /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:52:49.432804 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 12:52:49.433628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:52:49.433777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c (ip 10.222.0.26) !!! Sep 28 12:52:49.435380 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:52:49.436639 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=54 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:52:49.440588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:49.441356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:49.451705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:49.452180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:49.452638 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:49.453331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:49.453776 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:49.454192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:49.590366 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:49.598146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-461c90ad-9bfa-46a0-b9c2-6bf829386c10 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.167957 Sep 28 12:52:49.598709 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 957/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:49 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:50.623106 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:50.623827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:50.630834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:50.631305 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:50.631731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:50.632433 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:50.632880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:50.633296 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:50.639217 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a64b9db-a3ff-4567-8613-47939cbf5ad3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57466. Sep 28 12:52:50.766666 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:50.774328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-df22c42e-9cce-41c5-b43e-a9bc0482d53f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.156546 Sep 28 12:52:50.774894 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 989/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:50 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:51.797163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:51.797782 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:51.805415 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:51.805893 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:51.806365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:51.807055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:51.807508 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:51.807931 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:51.813222 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] [25ddd773-4fef-4fac-b591-2171ecb1d7f3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57472. Sep 28 12:52:51.936905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:51.944627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-da4425bf-23fc-4dc8-af66-c8d952a6bec4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.151267 Sep 28 12:52:51.945201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 958/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:51 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:52.967511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:52.968224 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:52.974824 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:52.975314 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:52.975995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:52.976485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:52.976973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:52.977363 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:53.116593 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:53.124855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3f6a4f0b-b9c5-4b32-9973-e29b83b451e8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.161211 Sep 28 12:52:53.125423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 990/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:52 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:54.147605 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:54.148216 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:54.155270 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:54.155750 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:54.156186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:54.156912 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:54.157368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:54.157795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:54.284659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:54.292922 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac25243d-3b28-4485-85dc-dabf5a1297fc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.149180 Sep 28 12:52:54.293484 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 959/1949] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:54 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:55.314997 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:55.315611 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:55.322694 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:55.323176 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:55.323605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:55.324291 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:55.324769 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:55.325194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:55.453374 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:55.461260 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7946b7a5-1c5f-4420-998a-240c2cb2e9d6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.150200 Sep 28 12:52:55.461832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 991/1950] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:55 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:56.484699 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:56.485431 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:56.492163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:56.492677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:56.493117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:56.493836 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:56.494336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:56.494763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:56.625037 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:56.632667 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d20479cb-786c-4752-a0f3-ac712d71afc9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.151811 Sep 28 12:52:56.633233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 960/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:56 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:57.654884 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:57.655484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:57.661835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:57.662306 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:57.662730 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:57.663408 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:57.663854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:57.664274 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:57.800172 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:57.810990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e9466e6e-6642-4263-8f45-7fea852ce3b8 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.159703 Sep 28 12:52:57.811878 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 992/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:57 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:52:58.834069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:52:58.834671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:52:58.841497 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:58.841971 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:58.842400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:58.843088 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:52:58.843535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:52:58.843956 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:52:58.969171 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:52:58.976741 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-993182b6-1333-48e8-9fd8-c39ea10ec797 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.146512 Sep 28 12:52:58.977301 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 961/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:58 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:00.000458 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:00.001105 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:00.007668 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:00.008173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:00.008686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:00.009815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:00.010256 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:00.010671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:00.139409 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:00.147071 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-41a82c30-c8d6-464d-b6d9-9a7b810c86f0 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.150512 Sep 28 12:53:00.147632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 993/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:52:59 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:01.169805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:01.170410 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:01.176920 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:01.177391 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:01.177819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:01.178499 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:01.178941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:01.179357 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:01.309593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:01.317257 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f3755712-3d9c-41c2-874d-6d862aa09edd tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.151344 Sep 28 12:53:01.317818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 962/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:01 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:02.341285 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:02.341834 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:02.348138 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.348661 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.349095 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.349787 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.350240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.350669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.482749 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:02.490970 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7ae76e7c-9587-4e8e-bf9e-b58f44c17e04 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1570 microversion: 2.1 time: 0.154293 Sep 28 12:53:02.491546 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 994/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:02 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:02.513845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:02.514584 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:02.521001 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.521668 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.522096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.522780 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.523224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.523654 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.568981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120637) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 12:53:02.634291 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d824d1a1-2f38-4fc2-bb84-a41ee036cde7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "POST /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action" status: 202 len: 0 microversion: 2.1 time: 0.124224 Sep 28 12:53:02.634814 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 963/1957] 10.222.0.26 () {60 vars in 1278 bytes} [Wed Sep 28 12:53:02 2022] POST /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:53:02.642841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:02.643485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:02.650097 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.650579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.651008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.651701 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:02.652153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:02.652609 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:02.783740 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:02.793941 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2ae4cfd5-5fe9-4d2a-bf82-4f6ac69a30c5 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1518 microversion: 2.1 time: 0.154843 Sep 28 12:53:02.794519 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 995/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:02 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:03.817078 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:03.817688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:03.824351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:03.824824 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:03.825254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:03.825941 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:03.826386 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:03.826805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:03.957488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:03.965905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f1671237-309d-4432-99fb-0e369e517e12 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1518 microversion: 2.1 time: 0.153082 Sep 28 12:53:03.966478 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 964/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:03 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:03.997258 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "name": "network-vif-unplugged", "status": "completed", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:04.007969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:04.008456 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:04.009108 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:04.020862 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.compute.server_external_events [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] Unable to find a host for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c. Dropping event network-vif-unplugged {{(pid=120636) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 12:53:04.021759 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-67a7f2da-0199-477b-84c1-9c66a3110c1e req-0aa62c43-ba60-4ea5-abfe-56a584eb7aea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028298 Sep 28 12:53:04.022351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 996/1960] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 12:53:04.990089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:04.990756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:04.997757 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:04.998229 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:04.998658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:04.999340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:04.999786 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:05.000206 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:05.126018 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:05.133677 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecdba280-1765-4fda-b6b0-dc97455b9be4 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1518 microversion: 2.1 time: 0.147664 Sep 28 12:53:05.134247 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 965/1961] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:04 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:06.156823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:06.157434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:06.163843 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:06.164300 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:06.164760 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:06.165449 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:06.165899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:06.166323 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:06.293929 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:06.301670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b25a8719-1b64-4bca-b777-9d91f21e6fb3 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1518 microversion: 2.1 time: 0.148718 Sep 28 12:53:06.302243 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 997/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:06 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:07.326567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:07.327177 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:07.333587 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:07.334064 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:07.334496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:07.335179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:07.335627 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:07.336048 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:07.460736 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:07.470789 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-98038859-f130-4425-815d-76884f3195ff tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1518 microversion: 2.1 time: 0.146694 Sep 28 12:53:07.471715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 966/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:07 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:08.494482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:08.495515 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:08.501634 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:08.502121 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:08.502539 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:08.503223 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:08.503667 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:08.504084 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:08.642624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:08.650807 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fba7d68c-b9b1-4c50-856d-b89898c5cc58 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.160245 Sep 28 12:53:08.651357 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 998/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:08 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:09.675201 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:09.675805 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:09.682179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:09.682647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:09.683075 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:09.683753 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:09.684198 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:09.684644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:09.818356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:09.826548 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-83e540d3-262f-400c-b3b3-e4396630bd07 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.155137 Sep 28 12:53:09.827115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 967/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:09 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:10.849920 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:10.850590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:10.857606 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:10.858078 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:10.858504 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:10.859179 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:10.859625 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:10.860041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:10.986065 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:10.994104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-90d62517-94f1-4e1b-99f8-968d20b29f02 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.148069 Sep 28 12:53:10.994672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 999/1966] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:10 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:12.016935 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:12.017579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:12.024117 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:12.025266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:12.025703 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:12.026395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:12.026847 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:12.027273 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:12.156612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:12.164192 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-aaf4fd6f-8d92-42cd-96a1-ae8f62b22b33 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.151134 Sep 28 12:53:12.164788 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 968/1967] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:12 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:13.186742 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:13.187350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:13.193815 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:13.194293 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:13.194728 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:13.195416 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:13.195867 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:13.196289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:13.339699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:13.347351 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-56c908c1-45ff-4f32-8fba-6623ae30bff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.164490 Sep 28 12:53:13.347910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1000/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:13 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:14.371535 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:14.372145 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:14.378650 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:14.379128 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:14.379555 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:14.380237 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:14.380715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:14.381139 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:14.510632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:14.518563 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-295c322f-4bc0-4a3f-a776-3725a4b3350b tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.151466 Sep 28 12:53:14.519124 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 969/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:14 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:15.542124 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:15.542671 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:15.549163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.549642 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.550076 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.550765 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.551216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.551638 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.679107 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:15.687412 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-e3a6b847-6955-43ed-82e1-7083ef81b22a tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.149220 Sep 28 12:53:15.687987 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1001/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:15 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:15.702644 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:15.703213 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:15.709918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.710392 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.710806 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.711483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.711930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.712369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.737130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Going to try to terminate instance {{(pid=120637) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:53:15.784647 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:15.811646 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c423f7e3-4afc-4796-95b3-e1a67f35df6c tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 204 len: 0 microversion: 2.1 time: 0.112420 Sep 28 12:53:15.812345 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 970/1971] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:53:15 2022] DELETE /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:53:15.820165 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:15.820806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:15.826696 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.827171 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.827605 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.828288 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:15.828774 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:15.829196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:15.959781 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:15.968023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1cc96ef0-8966-4a38-840f-403db1302ece tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1577 microversion: 2.1 time: 0.151770 Sep 28 12:53:15.968613 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1002/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:15 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:16.711460 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:16.712089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:16.718367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:16.718843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:16.719266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:16.719951 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:16.720436 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:16.720858 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:16.851099 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:16.858716 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-c3361f15-062f-4057-81ed-1256b5305ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.151613 Sep 28 12:53:16.859281 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 971/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:16 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:16.993975 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:16.994508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:17.001154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:17.001632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:17.002060 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:17.002744 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:17.003182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:17.003598 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:17.007477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:17.134557 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:17.142254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7b5d16df-0e07-4daa-b183-bcbc5fd3e2c9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1577 microversion: 2.1 time: 0.152542 Sep 28 12:53:17.142830 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1003/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:16 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:17.882114 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:17.882755 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:17.889643 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:17.890115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:17.890539 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:17.891254 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:17.891698 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:17.892116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:18.085683 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "name": "network-vif-plugged", "status": "completed", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:18.095966 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:18.096484 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:18.097063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:18.111422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] Creating event network-vif-plugged:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:53:18.125268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-023a7301-4a31-4b0d-8a93-d1be6329af86 req-8e0bcf18-6f70-4cd3-b2ec-80ee3e4fc956 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 Sep 28 12:53:18.125268 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1004/1975] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:53:18.168035 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:18.168725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:18.175577 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:18.176140 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:18.177650 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:18.178757 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:18.179219 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:18.179676 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:18.201778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:18.210033 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-6691cbca-519e-413f-9e12-0885cae34fd9 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.331663 Sep 28 12:53:18.210918 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 972/1976] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:17 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:18.312869 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:18.321002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f7c488d3-6cc5-4ddd-b15a-f9df539aa139 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1577 microversion: 2.1 time: 0.158573 Sep 28 12:53:18.331141 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1005/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:18 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:53:18.894350 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ec2325-e36b-4f3f-9fb6-6114edf484c7", "name": "network-vif-deleted", "tag": "a59dc084-4259-4942-8f31-989db629685e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:18.908056 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:18.909103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:18.909695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:18.924159 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] Creating event network-vif-deleted:a59dc084-4259-4942-8f31-989db629685e for instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 on hv-cinder-85919 Sep 28 12:53:18.929719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-dc657bd8-b2f3-4895-9f00-dca61d6c4b16 req-33e08b3b-53c6-47c1-9e3f-63e43fb76659 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 Sep 28 12:53:18.930315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 973/1978] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:53:19.234212 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:19.234817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:19.241958 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:19.242448 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:19.242886 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:19.243620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:19.244073 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:19.244528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:19.347204 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:19.347413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:19.353607 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:19.354174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:19.354682 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:19.355468 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:19.355999 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:19.356520 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:19.420930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:19.430538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a9f30b02-764f-4011-a298-b219cc5ce329 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 200 len: 1224 microversion: 2.1 time: 0.087805 Sep 28 12:53:19.431777 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 974/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:19 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:53:19.464620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:19.472628 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d34c7b8e-9257-4fea-87a6-d5705ec363c6 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1576 microversion: 2.1 time: 0.242437 Sep 28 12:53:19.473464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1006/1980] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:19 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:20.453417 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:20.454022 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:20.456487 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:20.461678 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:20.462695 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:20.463127 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:20.463822 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:20.464268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:20.464715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:20.478903 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] HTTP exception thrown: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Request method failure captured: Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 HTTP/1.1 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNEL1-4SAGghSNYQgR_-hQfpxlVa6cPv48S_bVYgn44-Xk9PH3vzsksPqLcJxzwqYGdVCsL1TbUWeSglVdh_qgLAxV6cbh20ZKLN0svH0BXcfdSsjiHwQHAe5GSjDjln8u1oc_PH-HjrVQubpFJRGAXhlGG9B27Hrq374VV0QgZ3bkPA Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:53:20.480564 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c8a6694cad9480f86dc4dca113bb762", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4d70d61439324d4b9c3b3513799b896c Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:53:20.481905 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '32ec2325-e36b-4f3f-9fb6-6114edf484c7'} Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:53:20.482659 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:53:20.483843 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:53:20.485335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Returning 404 to user: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:53:20.485335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-9c70927c-df9b-4eab-9681-e20051748e47 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 404 len: 111 microversion: 2.1 time: 0.032454 Sep 28 12:53:20.485335 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 975/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:20 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:53:20.498421 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:20.499255 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:20.506002 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=39 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:20.508594 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:20.509301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:20.509921 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:20.510632 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:20.511292 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:20.511726 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:20.587685 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-877085100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-136676255", "security_groups": [{"name": "tempest-secgroup-smoke-1087525056"}], "block_device_mapping_v2": [{"uuid": "2e1713ca-d90d-4a9c-81bf-e04020744973", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e691ab45-7c50-4cf7-b5bb-d7dde8084b2c"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:20.660377 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:20.669547 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-35f182a8-0b71-4967-800f-2b7d6d1e0ff7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1563 microversion: 2.1 time: 0.176468 Sep 28 12:53:20.670148 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1007/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:20 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:20.938067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] validate_networks() for [('e691ab45-7c50-4cf7-b5bb-d7dde8084b2c', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:53:21.468469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:53:21.468946 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:53:21.469336 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:53:21.469734 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:53:21.470136 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:53:21.479438 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:21.479910 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:21.480369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:21.481090 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:21.481537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:21.481954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:21.498764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:53:21.502590 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for user 4d70d61439324d4b9c3b3513799b896c and project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:53:21.561593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:53:21.563827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e1713ca-d90d-4a9c-81bf-e04020744973',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:53:21.698092 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-56c5fb82-ffd7-4984-82e7-95bf868e816f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.116214 Sep 28 12:53:21.698669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 976/1983] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:53:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 12:53:21.709880 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-bbbb9ef4-9c5e-4ce8-ad48-b1df25555a11 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:21.710498 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-bbbb9ef4-9c5e-4ce8-ad48-b1df25555a11 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:21.763923 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-bbbb9ef4-9c5e-4ce8-ad48-b1df25555a11 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:21.770919 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-bbbb9ef4-9c5e-4ce8-ad48-b1df25555a11 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1093 microversion: 2.1 time: 0.065014 Sep 28 12:53:21.771524 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1008/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:21 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:22.796160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:22.797320 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:22.803591 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:22.804077 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:22.804532 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:22.805236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:22.805688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:22.806104 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:22.902071 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:22.910015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-760225ff-4e8e-4d5f-8308-0cc35081dba6 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1209 microversion: 2.1 time: 0.119125 Sep 28 12:53:22.910617 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 977/1985] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:22 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:23.934346 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:23.934795 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:23.941768 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:23.942247 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:23.942675 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:23.943360 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:23.943832 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:23.944237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:24.073186 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b1518a-52ba-4d29-aa57-46e3e711fa35", "tag": "aa9f8552-a5ea-4c17-a724-79bf96af1947"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:24.081153 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:24.097854 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:24.098238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:24.098692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:24.103899 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-8a579ea3-fa7f-4ea4-a4b1-d3c9689c9e30 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.174168 Sep 28 12:53:24.104535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1009/1986] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:23 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:24.111305 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] Creating event network-changed:aa9f8552-a5ea-4c17-a724-79bf96af1947 for instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 on hv-cinder-85919 Sep 28 12:53:24.116533 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-87134c58-ac7c-480a-905b-659b32deec5a req-8e57a38f-71b0-457f-afbe-5a3ba9361b64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048862 Sep 28 12:53:24.117278 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 978/1987] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:53:25.127434 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:25.128039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:25.134980 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:25.135451 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:25.135882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:25.136585 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:25.137034 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:25.137455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:25.268910 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:25.276789 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-afc8cdf5-e351-4801-beff-521bbbdf3454 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.153166 Sep 28 12:53:25.277380 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1010/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:25 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:26.300382 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:26.301076 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:26.307140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:26.307612 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:26.308040 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:26.308763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:26.309194 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:26.309614 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:26.449307 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:26.456986 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ac97c540-ebd2-43f6-a7df-225b00a4988f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.161260 Sep 28 12:53:26.457549 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 979/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:26 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:27.484023 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:27.484699 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:27.491514 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:27.491989 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:27.492456 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:27.493201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:27.493678 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:27.494092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:27.620841 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:27.628508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-641fbb1e-a55c-4218-997c-2338215078b0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.152107 Sep 28 12:53:27.629075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1011/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:27 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:28.651730 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:28.652364 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:28.659179 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:28.659588 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:28.660015 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:28.660729 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:28.661176 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:28.661593 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:28.794934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:28.802596 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9f632a3-b17a-4340-a2ac-bb40ae30197b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.154774 Sep 28 12:53:28.803156 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 980/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:28 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:29.825991 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:29.826599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:29.833102 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:29.833576 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:29.834009 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:29.834689 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:29.835142 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:29.835563 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:29.967686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:29.975477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-c0b40876-f7a8-43ae-9f88-fcb8149697dc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.153335 Sep 28 12:53:29.976040 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1012/1992] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:29 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:30.998795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:30.999310 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:31.005842 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:31.006326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:31.006759 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:31.007455 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:31.007906 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:31.008356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:31.135954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:31.143756 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-2af4bba6-f914-4cd5-8d8f-cea395429fcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.148842 Sep 28 12:53:31.144349 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 981/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:30 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:32.167196 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:32.167848 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:32.171352 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:32.175350 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:32.175835 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:32.176270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:32.176984 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:32.177435 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:32.177855 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:32.309872 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:32.317462 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ceaa5ab7-97be-4ccc-9b1f-6dbd54223c06 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.154396 Sep 28 12:53:32.318049 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1013/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:32 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:33.340027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:33.340661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:33.342586 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:33.343298 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:53:33.349290 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:33.349763 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:33.350190 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:33.350870 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:33.351315 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:33.351731 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:33.486632 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:33.495163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59142dcb-2a6c-4ba6-a04e-8ba80f300d64 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.159378 Sep 28 12:53:33.495732 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 982/1995] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:33 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:34.134566 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b1518a-52ba-4d29-aa57-46e3e711fa35", "name": "network-vif-plugged", "status": "completed", "tag": "aa9f8552-a5ea-4c17-a724-79bf96af1947"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:34.144763 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:34.145237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:34.145673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:34.157426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] Creating event network-vif-plugged:aa9f8552-a5ea-4c17-a724-79bf96af1947 for instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 on hv-cinder-85919 Sep 28 12:53:34.162379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-c906925c-67f5-453f-90a5-bf11b52372ea req-cb6b835d-8f7b-4772-a063-8ea1526fad8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Sep 28 12:53:34.163013 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1014/1996] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:53:34.518342 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:34.518977 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:34.525992 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:34.526463 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:34.526890 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:34.527576 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:34.528025 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:34.528494 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:34.654625 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:34.662258 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3ad1512b-2abc-44a2-bd0b-e8bb308905be tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.147820 Sep 28 12:53:34.662819 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 983/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:34 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:35.685924 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:35.686620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:35.692844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:35.693325 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:35.693761 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:35.694455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:35.694904 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:35.695330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:35.824098 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:35.831969 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-7990516b-25ba-476b-b51e-ea0e013fe1a5 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1265 microversion: 2.1 time: 0.150693 Sep 28 12:53:35.832583 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1015/1998] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:35 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:36.854844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:36.855470 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:36.861872 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:36.862348 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:36.862778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:36.863465 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:36.863914 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:36.864351 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:36.996148 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:37.003988 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-f9426c55-0c6b-49c5-89ca-cc40b4bef517 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1452 microversion: 2.1 time: 0.153074 Sep 28 12:53:37.004579 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 984/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:36 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:37.026361 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:53:37.026959 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:53:37.033330 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:37.033806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:37.034240 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:37.034926 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:37.035379 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:37.035805 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:37.169334 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:53:37.177008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-29bfcff3-0951-4660-a4c9-b769916572bd tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1452 microversion: 2.1 time: 0.154482 Sep 28 12:53:37.177579 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1016/2000] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:53:37 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:53:38.719656 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b1518a-52ba-4d29-aa57-46e3e711fa35", "tag": "aa9f8552-a5ea-4c17-a724-79bf96af1947"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:53:38.739242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:53:38.739242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:53:38.739242 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:53:38.752178 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] Creating event network-changed:aa9f8552-a5ea-4c17-a724-79bf96af1947 for instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 on hv-cinder-85919 Sep 28 12:53:38.757362 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fade0d35-806d-4557-8ea0-1c098354d513 req-eac11784-660d-4418-b6b6-a55b26feb666 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041579 Sep 28 12:53:38.757954 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 985/2001] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:54:58.083270 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=21 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:54:58.084234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=68 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:54:58.087167 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:54:58.088067 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=70 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:54:58.090297 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:54:58.090849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:54:58.094069 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:54:58.098917 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:58.099476 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:58.100008 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:58.100849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:58.101590 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:58.102844 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:58.106510 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:58.106987 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:58.107424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:58.118878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] Creating event network-changed:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:54:58.124004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ec0ae3ad-5185-403d-9f86-7c80cc895b75 req-70c7c656-22c9-4ef0-9753-9416f1898daa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040343 Sep 28 12:54:58.124721 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 986/2002] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:54:58.130241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:54:58.215464 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-45e2be0d-605d-480f-ab1c-b66386a5a662 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 204 len: 0 microversion: 2.1 time: 0.134121 Sep 28 12:54:58.217873 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1017/2003] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:54:58 2022] DELETE /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:54:58.225688 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:54:58.226515 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:54:58.233143 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:58.233660 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:58.234121 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:58.234799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:58.235252 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:58.235671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:58.389930 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:54:58.398302 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-795ba506-20f0-4e9b-b1dc-a5688a218096 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.176750 Sep 28 12:54:58.398885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 987/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:54:58 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:54:59.426528 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:54:59.427220 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:54:59.433949 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:59.434415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:59.434840 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:59.435522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:54:59.435973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:54:59.436419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:54:59.579182 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:54:59.587543 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dc48c3ba-2691-44cf-a80f-98190fb784d7 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1569 microversion: 2.1 time: 0.165556 Sep 28 12:54:59.588110 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1018/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:54:59 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:55:00.611347 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:55:00.611878 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:55:00.619313 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:00.619798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:00.620233 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:00.620970 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:00.621421 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:00.621845 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:00.703960 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b287a26201c142f983d844c07df169e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '325a146c46e54eec898106e7b88a86b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:55:00.714360 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ecb4d278-750a-45cc-9147-22d79ad89d68 tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 200 len: 1384 microversion: 2.1 time: 0.106908 Sep 28 12:55:00.717815 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 988/2006] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:55:00 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 1384 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 12:55:00.720021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92864b0-c53b-4ab9-85ec-b308e7a81c7c", "name": "network-vif-deleted", "tag": "b1f14b2a-4076-435e-8503-242aa1d9542e"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:55:00.734215 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:00.734777 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:00.735267 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:00.748672 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] Creating event network-vif-deleted:b1f14b2a-4076-435e-8503-242aa1d9542e for instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c on hv-cinder-85919 Sep 28 12:55:00.754252 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-2e22d636-7083-451e-99f3-70ac087e6b9b req-9b5818fd-7449-48fa-8095-66eb6d32d852 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042656 Sep 28 12:55:00.754860 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1019/2007] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:55:01.739562 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:55:01.740132 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] [instance: d92864b0-c53b-4ab9-85ec-b308e7a81c7c] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:55:01.747989 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:01.748496 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:01.748932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:01.749658 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:01.750115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:01.750537 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:01.763885 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] HTTP exception thrown: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Request method failure captured: Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c HTTP/1.1 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNELEyiiZbLzUpVs7S14leX8duMbsOCQRsb3yS-WONGrk5mBIPwiKdbNvqsoY4cnTIK5d1g2DWKBBPSYEtSQU137wiUIdppNHCSU43wP45sQwzMr2ItB2PqQk6rXDEjOi_IXVoqDwWTBvV7PBDMk-7FYehCElDCn9aMMRoZ0ZKj4ioYo Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 325a146c46e54eec898106e7b88a86b6 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestShelveInstance-2067221980 Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:55:01.765541 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/325a146c46e54eec898106e7b88a86b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_325a146c46e54eec898106e7b88a86b6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/325a146c46e54eec898106e7b88a86b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/325a146c46e54eec898106e7b88a86b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestShelveInstance-2067221980 Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 325a146c46e54eec898106e7b88a86b6 Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestShelveInstance-2067221980 Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-TestShelveInstance-2067221980-project Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: b287a26201c142f983d844c07df169e9 Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestShelveInstance-2067221980-project Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. Sep 28 12:55:01.767130 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': 'd92864b0-c53b-4ab9-85ec-b308e7a81c7c'} Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:55:01.768044 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. Sep 28 12:55:01.769361 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:55:01.770424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Returning 404 to user: Instance d92864b0-c53b-4ab9-85ec-b308e7a81c7c could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:55:01.770424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-e25672e9-fe55-4cc6-b257-24c3f4f44acc tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c" status: 404 len: 111 microversion: 2.1 time: 0.031727 Sep 28 12:55:01.770424 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 989/2008] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:55:01 2022] GET /compute/v2.1/servers/d92864b0-c53b-4ab9-85ec-b308e7a81c7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:55:01.927446 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-d8d5f89c-da0f-418e-8bac-2dd7e252ee2f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] Calling method '.version_select at 0x7f3062805700>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:55:01.949875 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-d8d5f89c-da0f-418e-8bac-2dd7e252ee2f tempest-TestShelveInstance-2067221980 tempest-TestShelveInstance-2067221980-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600759875" status: 202 len: 0 microversion: 2.1 time: 0.026963 Sep 28 12:55:01.950510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1020/2009] 10.222.0.26 () {58 vars in 1254 bytes} [Wed Sep 28 12:55:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1600759875 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 12:55:56.803800 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1637484287", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-136676255", "security_groups": [{"name": "tempest-secgroup-smoke-1087525056"}], "block_device_mapping_v2": [{"uuid": "b9cc4fef-3605-4c94-b207-ecc681fd8410", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e691ab45-7c50-4cf7-b5bb-d7dde8084b2c"}]}} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:55:56.813849 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=8 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:55:56.814675 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=16 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:55:56.937835 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.network.neutron [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] validate_networks() for [('e691ab45-7c50-4cf7-b5bb-d7dde8084b2c', None, None, None, None, None)] {{(pid=120637) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 12:55:57.348280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 12:55:57.348737 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image limits 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 12:55:57.349239 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Flavor pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 12:55:57.349648 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Image pref 0:0:0 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 12:55:57.350055 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.virt.hardware [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 12:55:57.358816 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:57.359292 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:57.359723 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:57.360483 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:57.360936 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:57.361358 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:57.377860 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 12:55:57.381892 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.quota [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Getting quotas for user 4d70d61439324d4b9c3b3513799b896c and project 1c8a6694cad9480f86dc4dca113bb762. Resources: {'ram', 'instances', 'cores'} {{(pid=120637) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 12:55:57.438027 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Going to run 1 instances... {{(pid=120637) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 12:55:57.440283 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9cc4fef-3605-4c94-b207-ecc681fd8410',volume_size=None,volume_type=None)] {{(pid=120637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 12:55:57.575327 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [07d58d23-aad9-4a43-9b1a-81f3fd363a82] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 12:55:58.581981 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [07d58d23-aad9-4a43-9b1a-81f3fd363a82] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57822. Sep 28 12:55:58.586142 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-3fe6159a-2a83-42d3-b402-8dbf7d18c7b1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.786424 Sep 28 12:55:58.586778 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 990/2010] 10.222.0.26 () {60 vars in 1147 bytes} [Wed Sep 28 12:55:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 12:55:58.596118 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:55:58.596897 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:55:58.601093 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-2a16b417-9787-46d2-801a-162c37487383 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:55:58.601800 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-2a16b417-9787-46d2-801a-162c37487383 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:55:58.664838 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-2a16b417-9787-46d2-801a-162c37487383 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:55:58.671731 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-2a16b417-9787-46d2-801a-162c37487383 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1094 microversion: 2.1 time: 0.077141 Sep 28 12:55:58.672287 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1021/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:55:58 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:55:59.695319 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:55:59.696340 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:55:59.703567 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:59.704183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:59.704743 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:59.705592 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:55:59.706146 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:55:59.706671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:55:59.782665 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:55:59.790631 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-88f55557-ca0b-4bdd-a7e6-64282c64843b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1210 microversion: 2.1 time: 0.099921 Sep 28 12:55:59.791400 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 991/2012] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:55:59 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:00.813617 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:00.814237 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:00.821018 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:00.821508 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:00.821945 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:00.822647 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:00.823103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:00.823535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:00.960202 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:00.968525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-ec34dd6d-692a-4935-a4c1-9c01abbd8415 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.158729 Sep 28 12:56:00.969103 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1022/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:00 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:01.200007 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5c0a15-05ab-4199-b6e9-39fee1bc80f8", "tag": "69ccd84d-0e4c-41a2-a064-6e65d18a7908"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:56:01.209423 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:01.209899 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:01.210368 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:01.221098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] Creating event network-changed:69ccd84d-0e4c-41a2-a064-6e65d18a7908 for instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 on hv-cinder-85919 Sep 28 12:56:01.226238 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-ba1a8706-d593-4e3a-8b7e-8aeb8832411c req-4739ff36-84d0-4bb2-9ddf-9103b956924b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156544 Sep 28 12:56:01.227095 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 992/2014] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:56:01.991849 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:01.992511 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:01.999426 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:01.999905 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:02.000362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:02.001063 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:02.001535 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:02.001962 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:02.127430 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:02.135582 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-126f206a-adf8-4274-81c4-ace14f4c6a81 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.147915 Sep 28 12:56:02.136150 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1023/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:01 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:03.160021 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:03.160783 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:03.166873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:03.167353 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:03.167798 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:03.168519 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:03.168976 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:03.169401 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:03.304356 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:03.312268 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-ab4c6a05-f305-4953-bfc3-c55a16222443 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.156875 Sep 28 12:56:03.312856 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 993/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:03 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:04.335335 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:04.335947 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:04.342796 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:04.343266 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:04.343698 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:04.344407 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:04.344854 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:04.345269 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:04.476021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:04.484735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-0e42bd85-03a7-4055-993d-2e079545f0d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.153169 Sep 28 12:56:04.485241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1024/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:04 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:05.506943 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:05.507558 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:05.514719 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:05.515197 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:05.515628 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:05.516326 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:05.516799 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:05.517224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:05.648125 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:05.656279 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a18eb325-b7a7-4d4a-b27b-43559c9417ca tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.153202 Sep 28 12:56:05.656873 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 994/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:05 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:06.678882 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:06.679494 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:06.686400 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:06.686877 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:06.687312 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:06.687998 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:06.688485 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:06.688914 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:06.820791 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:06.828648 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-fb3661af-9880-4ad7-82f0-4046455319a1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.153580 Sep 28 12:56:06.829216 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1025/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:06 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:07.850852 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:07.851469 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:07.853886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=2 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:56:07.854572 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell0:SELECT=6 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:56:07.860365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:07.860844 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:07.861274 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:07.861963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:07.862413 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:07.862833 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:07.993781 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:08.001409 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-0b9ea693-3817-41ed-a585-176f2c423fb7 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.154373 Sep 28 12:56:08.001974 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 995/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:07 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:09.025537 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:09.026164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:09.028560 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell0:SELECT=2 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:56:09.034522 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:09.035037 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:09.035482 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:09.036177 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:09.036663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:09.037092 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:09.172127 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:09.179669 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-f10b2a15-37e8-4dc7-8201-96dff1c0f646 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.158096 Sep 28 12:56:09.180229 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1026/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:09 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:10.203162 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:10.203774 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:10.210183 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:10.210657 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:10.211089 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:10.211773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:10.212223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:10.212671 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:10.343318 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:10.350896 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-4a7a3ef0-543d-4c0a-b4f4-d60608d6bf1e tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.152153 Sep 28 12:56:10.351527 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 996/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:10 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:11.373599 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:11.374207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:11.380510 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:11.380990 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:11.381419 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:11.382104 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:11.382550 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:11.382973 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:11.517624 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:11.525411 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9c389d79-56da-4af3-8517-458bf554bdd0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.155643 Sep 28 12:56:11.525981 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1027/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:11 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:12.549266 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:12.549869 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:12.556255 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:12.556762 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:12.557191 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:12.557865 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:12.558314 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:12.558758 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:12.691029 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:12.698645 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-59dcfc65-0389-4e2f-bed9-50dc16de6f9d tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.153163 Sep 28 12:56:12.699211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 997/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:12 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:13.067940 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5c0a15-05ab-4199-b6e9-39fee1bc80f8", "name": "network-vif-plugged", "status": "completed", "tag": "69ccd84d-0e4c-41a2-a064-6e65d18a7908"}]} {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:56:13.078170 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:13.078707 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:13.079146 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:13.090407 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.compute.server_external_events [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] Creating event network-vif-plugged:69ccd84d-0e4c-41a2-a064-6e65d18a7908 for instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 on hv-cinder-85919 Sep 28 12:56:13.095422 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [req-e79665ce-1a32-417e-9557-a9611db8950a req-fb8f8a50-5e9b-4e1a-a1c9-cedf8e0daeb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091796 Sep 28 12:56:13.095978 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1028/2025] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:56:13.721365 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:13.721883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:13.728245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:13.728749 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:13.729240 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:13.729940 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:13.730859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:13.731276 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:13.863812 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:13.872280 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-d5c9da00-d4b4-492b-8b96-966797dcb6e0 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.154817 Sep 28 12:56:13.872855 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 998/2026] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:13 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:14.895806 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:14.896526 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:14.902697 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:14.903169 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:14.903601 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:14.904281 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:14.904753 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:14.905173 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:15.042518 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:15.051167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-dedba0c6-8891-4fc6-b163-7b5572be1ee9 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1266 microversion: 2.1 time: 0.160315 Sep 28 12:56:15.051739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1029/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:14 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:16.075224 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:16.075853 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:16.082223 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:16.082693 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:16.083116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:16.083797 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:16.084245 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:16.084692 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:16.217338 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:16.224963 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-8c82b2f2-61c8-428f-8f9d-98e93fae21d2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1454 microversion: 2.1 time: 0.154179 Sep 28 12:56:16.225529 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 999/2028] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:16 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:16.248116 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:56:16.248758 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:56:16.255122 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:16.255600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:16.256033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:16.256743 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:16.257194 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:16.257623 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:16.397719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:56:16.405385 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-471b9614-5dd1-45ab-82d7-1dd2a2c833d1 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1454 microversion: 2.1 time: 0.161756 Sep 28 12:56:16.405957 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1030/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:56:16 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:56:18.389331 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5c0a15-05ab-4199-b6e9-39fee1bc80f8", "tag": "69ccd84d-0e4c-41a2-a064-6e65d18a7908"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:56:18.398554 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:56:18.399020 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:56:18.399443 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:56:18.412160 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] Creating event network-changed:69ccd84d-0e4c-41a2-a064-6e65d18a7908 for instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 on hv-cinder-85919 Sep 28 12:56:18.417316 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-fbd66098-4912-4f54-83fe-c814299b6b12 req-99ad7a5b-a386-4ece-ac4c-97ef9098e3d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120970 Sep 28 12:56:18.417932 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1000/2030] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:58:08.825755 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_api:SELECT=22 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:58:08.826561 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG dbcounter [-] [120636] Writing DB stats nova_cell1:SELECT=50 {{(pid=120636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:58:08.827842 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:58:08.828017 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 (ip 10.222.0.26) !!! Sep 28 12:58:08.829234 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 28 12:58:08.829362 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Wed Sep 28 12:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 (ip 10.222.0.26) !!! Sep 28 12:58:08.832683 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5c0a15-05ab-4199-b6e9-39fee1bc80f8", "tag": "69ccd84d-0e4c-41a2-a064-6e65d18a7908"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:58:08.833512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:08.834012 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:08.839261 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:58:08.839900 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG dbcounter [-] [120637] Writing DB stats nova_cell1:SELECT=54 {{(pid=120637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 12:58:08.841600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 12:58:08.841720 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Wed Sep 28 12:58:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 28 12:58:08.850115 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:08.850581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:08.851002 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:08.863581 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] Creating event network-changed:69ccd84d-0e4c-41a2-a064-6e65d18a7908 for instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 on hv-cinder-85919 Sep 28 12:58:08.864225 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:08.864735 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:08.865167 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:08.865870 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:08.866318 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:08.866741 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:08.870547 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-d0ffec70-0587-48d8-97bd-14d9dffb647a req-c1da89e1-911b-44c5-aaa1-474239cd4a20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044108 Sep 28 12:58:08.871825 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1001/2031] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:58:08.897315 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:58:08.982811 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-5b4ad0bb-f6e2-4f9d-a978-e54d4723a10f tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 204 len: 0 microversion: 2.1 time: 0.158639 Sep 28 12:58:08.984087 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1031/2032] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:58:08 2022] DELETE /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:58:08.993764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:08.995026 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:09.001395 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:09.002166 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:09.002661 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:09.003456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:09.004122 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:09.004624 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:09.142848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:09.150706 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-bf462545-ab42-4310-8a57-5d6491df7793 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1578 microversion: 2.1 time: 0.161361 Sep 28 12:58:09.151284 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1002/2033] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:08 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:10.175205 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:10.175911 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:10.182686 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:10.183164 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:10.183604 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:10.184301 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:10.184778 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:10.185207 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:10.320041 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:10.327823 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-1a04417f-d8a0-4417-913d-ddcd05f938c2 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1578 microversion: 2.1 time: 0.156889 Sep 28 12:58:10.328925 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1032/2034] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:10 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:11.270738 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5c0a15-05ab-4199-b6e9-39fee1bc80f8", "name": "network-vif-deleted", "tag": "69ccd84d-0e4c-41a2-a064-6e65d18a7908"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:58:11.282871 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:11.283456 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:11.283948 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:11.296630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] Creating event network-vif-deleted:69ccd84d-0e4c-41a2-a064-6e65d18a7908 for instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 on hv-cinder-85919 Sep 28 12:58:11.302449 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-46f96b55-abd2-41cb-ab2d-a96c81826dd1 req-adb79470-9045-4a50-bdbb-014a9a3eadc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035470 Sep 28 12:58:11.303058 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1003/2035] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:58:11.350956 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:11.351552 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:11.357937 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:11.358423 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:11.358859 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:11.360241 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:11.360725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:11.361154 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:11.421134 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:11.429506 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-a55932d7-639c-4ab0-971f-cb25b0291024 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 200 len: 1225 microversion: 2.1 time: 0.082383 Sep 28 12:58:11.430075 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1033/2036] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:11 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:12.453411 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:12.454116 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:12.460211 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:12.460727 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:12.461164 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:12.461859 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:12.462312 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:12.462764 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:12.476004 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] HTTP exception thrown: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Request method failure captured: Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 HTTP/1.1 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNEL1-4SAGghSNYQgR_-hQfpxlVa6cPv48S_bVYgn44-Xk9PH3vzsksPqLcJxzwqYGdVCsL1TbUWeSglVdh_qgLAxV6cbh20ZKLN0svH0BXcfdSsjiHwQHAe5GSjDjln8u1oc_PH-HjrVQubpFJRGAXhlGG9B27Hrq374VV0QgZ3bkPA Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:58:12.477626 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c8a6694cad9480f86dc4dca113bb762", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4d70d61439324d4b9c3b3513799b896c Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. Sep 28 12:58:12.479369 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '0f5c0a15-05ab-4199-b6e9-39fee1bc80f8'} Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:58:12.480293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. Sep 28 12:58:12.482036 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:12.483488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Returning 404 to user: Instance 0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:58:12.483488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-a7d3fb05-03e0-4d66-a54a-cb5e299ed45b tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8" status: 404 len: 111 microversion: 2.1 time: 0.030302 Sep 28 12:58:12.483488 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1004/2037] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:12 2022] GET /compute/v2.1/servers/0f5c0a15-05ab-4199-b6e9-39fee1bc80f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:58:15.540415 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:15.541072 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:15.544810 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b1518a-52ba-4d29-aa57-46e3e711fa35", "tag": "aa9f8552-a5ea-4c17-a724-79bf96af1947"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:58:15.547512 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:15.547995 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:15.548455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:15.549147 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:15.549600 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:15.550021 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:15.560504 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:15.561367 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:15.561669 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:15.574531 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] Creating event network-changed:aa9f8552-a5ea-4c17-a724-79bf96af1947 for instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 on hv-cinder-85919 Sep 28 12:58:15.580827 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-28257a41-c05b-4e62-b2d0-3662c682753c req-b2adbc1c-ff40-4966-8883-6bbf72b8a8bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039340 Sep 28 12:58:15.582103 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1005/2038] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 12:58:15.583126 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Going to try to terminate instance {{(pid=120636) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 12:58:15.678455 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-48584ea4-0cf3-4039-b49a-7352366ff485 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 204 len: 0 microversion: 2.1 time: 0.141670 Sep 28 12:58:15.679670 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1034/2039] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:58:15 2022] DELETE /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 12:58:15.688770 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:15.689705 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:15.696634 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:15.697208 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:15.697790 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:15.698594 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:15.699140 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:15.699773 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:15.848923 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.policy [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120637) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:15.858739 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-de9c65d9-509b-4657-96e9-6b678e1a6878 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1577 microversion: 2.1 time: 0.174387 Sep 28 12:58:15.859477 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1006/2040] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:15 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:16.883559 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:16.884376 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:16.891030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:16.891502 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:16.891933 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:16.892673 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:16.893117 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:16.894030 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:17.034100 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:17.042480 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-cd70ea0c-2f57-42a5-b479-c0fcf679f4b4 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1577 microversion: 2.1 time: 0.163160 Sep 28 12:58:17.043039 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1035/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:16 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:17.715934 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b1518a-52ba-4d29-aa57-46e3e711fa35", "name": "network-vif-deleted", "tag": "aa9f8552-a5ea-4c17-a724-79bf96af1947"}]} {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 12:58:17.726163 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:17.726630 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:17.727061 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:17.739098 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.compute.server_external_events [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] Creating event network-vif-deleted:aa9f8552-a5ea-4c17-a724-79bf96af1947 for instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 on hv-cinder-85919 Sep 28 12:58:17.744180 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [req-c3ee6b7b-eff7-43c7-9301-9b714bb0a7dd req-43548f1b-3c60-417f-8f24-df46f3f8a8b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Sep 28 12:58:17.744818 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1007/2042] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Sep 28 12:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 12:58:18.066201 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:18.066818 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:18.073695 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:18.074181 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:18.074620 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:18.075328 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:18.075782 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:18.076206 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:18.109725 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:18.110316 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:18.110827 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:18.111286 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.objects.instance [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lazy-loading 'fault' on Instance uuid e5b1518a-52ba-4d29-aa57-46e3e711fa35 {{(pid=120636) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 12:58:18.153857 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.policy [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d70d61439324d4b9c3b3513799b896c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8a6694cad9480f86dc4dca113bb762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120636) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 12:58:18.162227 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-9c42f08c-8d6a-4dbd-b20f-3a7933ef54ea tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 200 len: 1229 microversion: 2.1 time: 0.100293 Sep 28 12:58:18.162739 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1036/2043] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:18 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 12:58:19.188826 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:19.189538 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: e5b1518a-52ba-4d29-aa57-46e3e711fa35] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:19.196220 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.196746 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.197174 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.197848 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.198293 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.198715 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.211600 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] HTTP exception thrown: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Request method failure captured: Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 HTTP/1.1 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNEL1-4SAGghSNYQgR_-hQfpxlVa6cPv48S_bVYgn44-Xk9PH3vzsksPqLcJxzwqYGdVCsL1TbUWeSglVdh_qgLAxV6cbh20ZKLN0svH0BXcfdSsjiHwQHAe5GSjDjln8u1oc_PH-HjrVQubpFJRGAXhlGG9B27Hrq374VV0QgZ3bkPA Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:58:19.213236 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c8a6694cad9480f86dc4dca113bb762", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4d70d61439324d4b9c3b3513799b896c Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. Sep 28 12:58:19.214795 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': 'e5b1518a-52ba-4d29-aa57-46e3e711fa35'} Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:58:19.215883 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. Sep 28 12:58:19.217434 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.219060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Returning 404 to user: Instance e5b1518a-52ba-4d29-aa57-46e3e711fa35 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:58:19.219060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-65bd7af7-b2f5-41e4-a185-67711e498dcc tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35" status: 404 len: 111 microversion: 2.1 time: 0.030842 Sep 28 12:58:19.219060 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1008/2044] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:19 2022] GET /compute/v2.1/servers/e5b1518a-52ba-4d29-aa57-46e3e711fa35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:58:19.644289 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:19.644853 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.compute.api [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120636) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:19.651663 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.652163 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.652817 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.653542 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.654033 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.654477 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG oslo_concurrency.lockutils [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120636) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.668569 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.wsgi [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] HTTP exception thrown: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Request method failure captured: Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: request: DELETE /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 HTTP/1.1 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept: application/json Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Accept-Encoding: identity Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Connection: close Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Length: 0 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Content-Type: application/json Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Host: 10.222.0.26 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: Openstack-System-Scope: None Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: User-Agent: python-urllib3/1.26.12 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Auth-Token: gAAAAABjNEL1-4SAGghSNYQgR_-hQfpxlVa6cPv48S_bVYgn44-Xk9PH3vzsksPqLcJxzwqYGdVCsL1TbUWeSglVdh_qgLAxV6cbh20ZKLN0svH0BXcfdSsjiHwQHAe5GSjDjln8u1oc_PH-HjrVQubpFJRGAXhlGG9B27Hrq374VV0QgZ3bkPA Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Id: None Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Domain-Name: None Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Identity-Status: Confirmed Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Is-Admin-Project: True Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Id: default Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Domain-Name: Default Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Project-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Role: reader,member Sep 28 12:58:19.670254 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Roles: reader,member Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c8a6694cad9480f86dc4dca113bb762", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-Tenant-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Id: default Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Domain-Name: Default Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Id: 4d70d61439324d4b9c3b3513799b896c Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: X-User-Name: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: method: > Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: exception: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.671723 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: action_args: {'id': '32ec2325-e36b-4f3f-9fb6-6114edf484c7'} Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:58:19.672571 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.673719 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.674863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Returning 404 to user: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. {{(pid=120636) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:58:19.674863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-3942ba36-a31e-41f4-810b-498460fbaa77 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 404 len: 111 microversion: 2.1 time: 0.031581 Sep 28 12:58:19.674863 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1037/2045] 10.222.0.26 () {58 vars in 1239 bytes} [Wed Sep 28 12:58:19 2022] DELETE /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:58:19.680299 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '>' {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:19.680925 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.compute.api [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] [instance: 32ec2325-e36b-4f3f-9fb6-6114edf484c7] Fetching instance by UUID {{(pid=120637) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 12:58:19.686813 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.687287 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.687717 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.688439 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Acquiring lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 12:58:19.688886 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 12:58:19.689306 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG oslo_concurrency.lockutils [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Lock "a18cfeac-065c-467a-bfbd-7a49d1a8c790" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 12:58:19.702895 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.wsgi [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] HTTP exception thrown: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Request method failure captured: Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: request: GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 HTTP/1.1 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept: application/json Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Accept-Encoding: identity Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Connection: close Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Length: 0 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Content-Type: application/json Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Host: 10.222.0.26 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: Openstack-System-Scope: None Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: User-Agent: python-urllib3/1.26.12 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Auth-Token: gAAAAABjNEL1-4SAGghSNYQgR_-hQfpxlVa6cPv48S_bVYgn44-Xk9PH3vzsksPqLcJxzwqYGdVCsL1TbUWeSglVdh_qgLAxV6cbh20ZKLN0svH0BXcfdSsjiHwQHAe5GSjDjln8u1oc_PH-HjrVQubpFJRGAXhlGG9B27Hrq374VV0QgZ3bkPA Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Id: None Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Domain-Name: None Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Identity-Status: Confirmed Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Is-Admin-Project: True Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Id: default Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Domain-Name: Default Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Project-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Role: reader,member Sep 28 12:58:19.704388 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Roles: reader,member Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c8a6694cad9480f86dc4dca113bb762", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c8a6694cad9480f86dc4dca113bb762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}] Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Id: 1c8a6694cad9480f86dc4dca113bb762 Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1133624537 Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Id: default Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Domain-Name: Default Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Id: 4d70d61439324d4b9c3b3513799b896c Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: X-User-Name: tempest-TestVolumeBootPattern-1133624537-project Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: method: > Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: exception: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.705863 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: action_args: {'id': '32ec2325-e36b-4f3f-9fb6-6114edf484c7'} Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: {{(pid=120637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 12:58:19.707253 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. Sep 28 12:58:19.708740 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: ERROR nova.api.openstack.wsgi Sep 28 12:58:19.710096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: DEBUG nova.api.openstack.wsgi [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Returning 404 to user: Instance 32ec2325-e36b-4f3f-9fb6-6114edf484c7 could not be found. {{(pid=120637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 12:58:19.710096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: INFO nova.api.openstack.requestlog [None req-539cb9e4-29fd-457d-9e05-6ebb3273b705 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7" status: 404 len: 111 microversion: 2.1 time: 0.029269 Sep 28 12:58:19.710096 dv-cinder-859193-2-iscsi devstack@n-api.service[120637]: [pid: 120637|app: 0|req: 1009/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Wed Sep 28 12:58:19 2022] GET /compute/v2.1/servers/32ec2325-e36b-4f3f-9fb6-6114edf484c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 12:58:21.010083 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: DEBUG nova.api.openstack.wsgi [None req-b5b41d2b-668a-4e82-b552-30ade89a3302 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] Calling method '.version_select at 0x7f30625534c0>' {{(pid=120636) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 12:58:21.035525 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: INFO nova.api.openstack.requestlog [None req-b5b41d2b-668a-4e82-b552-30ade89a3302 tempest-TestVolumeBootPattern-1133624537 tempest-TestVolumeBootPattern-1133624537-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-136676255" status: 202 len: 0 microversion: 2.1 time: 0.029085 Sep 28 12:58:21.036232 dv-cinder-859193-2-iscsi devstack@n-api.service[120636]: [pid: 120636|app: 0|req: 1038/2047] 10.222.0.26 () {58 vars in 1260 bytes} [Wed Sep 28 12:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-136676255 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)